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ABSTRACT 


A  study  and  documentation  of  the  first  annual  Award  for 
Excellence  in  Teaching  is  made.   A  brief  background  for  the 
Award  is  presented,  including  the  formation  of  a  committee 
designated  to  choose  objectively  a  worthy  recipient.   The 
problems  encountered  by  the  committee  in  designing  a  success- 
ful ballot  and  the  statistical  methods  used  in  selecting  the 
recipient  are  of  major  concern  and  are  treated  in  detail. 
Basic  response  statistics  are  published  accompanied  by  a 
data  summary.   Special  studies  including  score  analysis, 
weight  component  determination,  and  teacher  elimination  by 
dominance  techniques  are  presented.   To  better  understand 
the  various  population  strata,  several  correlation  studies 
are  made  . 
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I.   BACKGROUND 

In  May,  1969,  the  Superintendent  of  the  Naval  Postgrad- 
uate School,  Radm.  Robert  W.  McNitt,  USN ,  established  the 
Outstanding  Teaching  Award  to  be  conferred  upon  a  member  of 
the  Faculty  of  the  Naval  Postgraduate  School  annually  at  the 
time  of  the  June  Graduation  Exercises.   It  was  intended  that 
the  first  conferral  of  the  Award  be  made  in  June,  1970. 

Selection  of  the  recipient  was  to  be  accomplished  accord- 
ing to  certain  guideline  procedures  prepared  by  an  Ad  Hoc 
Committee  appointed  by  the  Academic  Dean.   The  Ad  Hoc  Commit- 
tee consisted  of  Professors  Gaskell  (Chairman) ,  Handler, 
O'Toole,  and  Strum.   In  addition  to  basic  guidelines,  the  Ad 
Hoc  Committee  made  provisions  for  the  establishment  of  a 
permanent  selection  committee  to  choose  the  recipient  annually, 
thus  insuring  a  growing  efficiency  and  refinement  of  the  pro- 
cess.  Membership  on  the  committee  would  be  for  two  year  pe- 
reiods ,  with  exception  of  the  first  committee,  and  each  year 
half  of  the  committee  would  step  down,  thus  combining  past 
knowledge  and  familiarity  of  the  problem  with  new  talents 
and  ideas. 

The  first  selection  committee  finally  evolved  to  the 
membership  of  Professors  Gawain  (Chairman) ,  Kovach  (Vice- 
Chairman  and  Secretary),  Boggess,  Nunn,  Read,  Strum,  and 
Woehler.   The  initj al  efforts  of  the  selection  committee 
were  towards  setting  a  general  tone  for  the  award  itself. 
It  was  felt  that  a  small  group  of  the  Faculty  members  could 


be  identified  who  merit  consideration  for  the  Award,  but 
that  a  selection  from  among  this  group  of  one  individual, 
however  deserving  he  may  be,  was  not  likely  to  preempt  all 
other  candidates  in  every  respect.  Therefore,  it  was  felt 
that  the  selection  of  one  individual  could  properly  be  re- 
garded as  a  representative  and  symbol  of  the  excellence  of 
his  peers. 

In  attempting  to  fulfill  its  assigned  responsibilities, 
the  committee  tried  to  formulate  an  adequate  philosophical 
outlook  concerning  the  nature  of  excellence  in  teaching  and 
how  it  could  be  reliably  identified  and  evaluated.   After 
much  research,  both  outside  and  inside  the  committee,  the 
Committee  reached  the  following  general  conclusions : 

(a)  There  did  not  exist  any  objective  and  gener- 
ally accepted  method  for  quantitatively  measuring 
excellence  in  teaching. 

(b)  Experience  at  the  Naval  Postgraduate  School 
and  elsewhere  indicated  that  mature  students  and 
other  qualified  observers  do  on  the  whole  show  a 
reasonable  degree  of  consistency  in  judgments  of 
persons  engaged  in  teaching. 

(c)  The  Committee  could  properly  designate  the 
recipient  on  the  basis  of  the  representative  judg- 
ments of  persons  qualified  to  hold  opinions. 

(d)  It  appeared  that  a  polling  procedure  could 
be  used  to  achieve  this  objective. 

(e)  Well  developed  statistical  techniques  were 
available  which  could  be  used  to  guide  the  quanti- 
tative interpretation  of  the  poll. 

The  Committee  next  desired  to  put  down  on  paper  some 
statement  that  approached  the  correct  interpretation  of  the 
phrase  "excellence  in  teaching."   This  phrase  was  to  .refer 
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to  that  complex  of  personal  and  professional  qualities  and 
actions  on  the  part  of  the  teacher  which: 

(a)  Make  themselves  felt  primarily  at  the  inter- 
face of  personal  contact  between  student  and  teacher. 

(b)  Help  transmute  the  student's  encounters  with 
his  subject  matter  into  insight,  enlightenment  and 
love  of  learning. 

(c)  Elicit  from  the  student  responses  in  thought, 
feeling,  and  action  which  enhance  his  capacity  for 

•  self  education. 

(d)  Manifest  themselves  in  an  effective  individual 
style  which  authentically  reflects  the  teacher's 
own  unique  personality,  experience,  character,  and 
convictions . 

With  reference  to  the  actual  polling  procedure  to  be 

followed,  the  Committee  proposed  the  following  specific  points: 

(a)   The  following  individuals  would  be  eligible  to 
participate:   all  students,  all  Faculty  members,1 
all  Curricular  and  Assistant  Curricular  Officers, 
and  a  representative  group  of  recent  alumni.   The 
exact  composition  of  this  group  to  be  specified  later, 

(to)   Participation  in  the  poll  would  be  entirely 
voluntary. 

(c)  The  polling  would  be  by  secret  ballot. 

(d)  Stringent  security  measures  would  be  taken  to 
guarantee  that  the  poll  could  not  be  misused  in  any 
fashion  which  would  be  detrimental  to  the  status  or 
interests  of  any  individual  Faculty  member. 

(e)  In  order  to  be  eligible  to  participate  in  the 
poll,  an  individual  must  have  indicated  that  he  con- 
siders himself  to  be  reasonably  well  acquainted  with 
the  actual  teaching  performance  of  five  or  more 
Faculty  members. 


department  Chairmen  and  members  of  the  Selection  Committee 
were  declared  ineligible  to  receive  the  award.   They  were  not 
excluded  from  the  poll,  however. 
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(f)  Participants  would  be  cautioned  to  avoid 
nominating  teachers  on  the  basis  of  mere  personal- 
ity or  popularity.   No  attempt  would  be  made  to 
provide  a  definite  check  list  of  required  qualities 
for  excellence  in  teaching.   The  Committee's  guide- 
lines in  this  area  were  to  be  optional. 

(g)  Data  obtained  in  the  poll  would  be  analyzed 
objectively,  using  appropriate  statistical  methods 
which  would  take  into  account  all  relevant  factors. 
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II.   CONDUCT  OF  POLL 

A.   BALLOT  FORMAT 

After  setting  the  philosophical  tone  of  the  award,  the 
selection  committee  directed  its  attention  to  the  appropriate 
ballot  format.   It  was  decided  that  the  ballot  itself  would 
consist  of  three  basic  parts.   The  first,  a  statistical  infor- 
mation section,  was  designed  to  obtain  data  to  help  understand 
various  characteristics  of  the  polled  population.   The  second 
part  consisted  of  a  listing  of  the  faculty  eligible  for  the 
teaching  award,  and  the  third  part  was  to  invite  a  supporting 
remark  for  the  voter's  primary  nomination.   A  sample  ballot 
is  included  in  Appendix  A. 

Information  requested  in  Part  I  of  the  ballot  provided 
data  for  statistical  procedures  to  be  used  in  an  effort  to 
gain  a  better  understanding  of  the  voter  population.   It  was 
desired  to  know  the  Voter  Category  of  each  individual  being 
polled.   Consequently,  the  four  categories  consisting  of 
Student,  Faculty,  Alumnus,  and  Curricular  Officer  were  used. 
These  four  categories  were  desired  to  be  mutually  exclusive 
and  totally  exhaustive. 

If  the  voter  were  military,  additional  information  as  to 
Rank  and  Branch  of  Service  was  requested.   If  the  voter  were 
a  student,  his  curricular  area  would  be  of"  interest,  and  if 
he  were  a  member  of  the  Faculty,  his  Academic  Rank  and  Depart- 
ment would  supply  pertinent  statistical  information. 
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The  second  part  of  the  ballot  displayed  a  listing  of  the 
eligible  faculty,  or  those  faculty  who  had  engaged  in  teach- 
ing during  the  current  academic  year,  except  department  chair- 
men and  members  of  the  selection  committee. 

An  effective  method  of  listing  the  eligible  faculty  was 
desired.   The  committee,  realizing  that  most  students  (and 
consequently,  alumnus)  and  faculty  identified  a  teacher  with 
an  academic  department,  decided  to  have  thirteen  major  heads 
corresponding  to  the  thirteen  departments.   Within  each  de- 
partment, the  teachers  were  listed  alphabetically.   Hopefully 
this  method  would  facilitate  finding  a  specified  group  of 
teachers  with  which  the  voter  would  be  acquainted. 

Part  III  was  included  to  obtain  subjective  information 
supporting  the  primary  nomination  of  the  voter  concerned. 
Since  this  information  was  optional,  the  committee  decided 
not  to  fix  any  policies  regarding  its  usage  in  the  selection 
process.   But,  such  information  would  provide  an  inlet  for 
subjectivity  in  the  process  which  the  committee  felt  might 
be  necessary  and  appropriate. 

To  accompany  the  actual  ballot,  a  page  of  publicity  and 
instruction  was  felt  necessary.  The  committee  decided  that 
such  a  page  should  consist  basically  of  two  parts:  a  short 
statement  of  the  background  of  the  award  and  a  statement  of 
the  balloting  procedure.  Therefore,  a  short  summary  of  the 
philosophical  thinking  of  the  committee  was  included  to 
introduce  the  subject  of  "teaching  excellence"  to  the  voter. 
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The  balloting  procedure  consisted  of  five  steps;  three 
of  which  require  explanation.   Step  1  requested  the  voter  to 
encircle  the  teacher  number  of  all  the  faculty  with  which  he 
was  "sufficiently  acquainted  to  make  a  judgment."   It  was 
emphasized  that  the  voter  encircle  all  those  that  fell  into 
the  above  category  in  order  to  establish  a  basis  of  comparison. 

In  Step  2,  the  voter  was  directed  to  select  one  (1)  to 
three  (3)  nominees  and  to  rank  them  in  order  of  preference. 
The  committee  decided  that  a  scoring  system  would  be  based 
on  points  awarded  for  first,  second,  and  third  place  votes 
only. 

Finally,  Step  3  invited  the  voter  to  utilize  Part  III  of 
the  actual  ballot  by  giving  supporting  remarks  for  his  first 
place  nomination.   This  step  was  to  be  optional. 

B.   VERIFICATION  OF  DATA 

The  listing  of  teachers  described  above  included  a  four 
digit  number  identifying  each  teacher.   These  numbers  served 
a  two-fold  purpose.   They  were  used  in  the  processes  of  data 
collection  and  statistical  manipulation;  and  secondly,  the 
numbers  served  as  a  verification  process  by  which  the  IBM 
data  cards  could  be  checked  for  key  punch  errors. 

Each  teacher  number  was  constructed  in  the  following 
manner.   The  first  three  digits  formed  a  number  that  increased 
in  numerical  order  for  each  teacher  going  down  the  listing, 
starting  with  number  101.   Therefore,  the  second  teacher  down 
the  list  had  the  first  three  digits  102,  the  third  teacher, 
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103,  etc.   Let  N   be  a  vector  whose  elements  consist  of 
these  first  three  digits.   The  fourth  digit  of  the  teacher 
number  was  obtained  by  using  the  units  digit  of  the  inner 
product  N  •  S1  ,  where   S   was  an  arbitrary  weight  vector 
chosen  to   (3  5  1).   As  an  example,  for  teacher  101,  the 
fourth  digit  would  be  the  units  digit  of 

(1  0  1)  [  5  ]   or   4  . 

Thus,  his  full  number  would  be  1014.   This  procedure  rendered 
itself  to  computer  verification  of  all  key  punched  data  cards. 
Other  verification  techniques  appropriate  to  the  programming 
language  (COBOL)  were  used  for  the  statistical  information 
provided  in  Part  I  of  the  ballot. 

C.   RESPONSE  ANOMALIES 

Although  much  effort  was  put  into  the  design  of  the  ballot 
format,  it  was  anticipated  that  not  every  point  would  be  clear 
to  the  individual  voter.   An  analysis  of  the  returned  ballots 
proved  this  conjecture  to  be  true. 

Multiple  answers  in  any  one  of  the  informational  areas  of 
Part  I  would  cause  problems  for  proper  statistical  analysis. 
It  was  found  that  although  the  Voter  Category  information  was 
totally  exhaustive,  it  was  not  mutually  exclusive,  especially 
among  the  Alumnus  and  Curricular  Officer  categories.  Conse- 
quently, revision  of  the  collection  process  for  this  informa- 
tion is  required.   Confusion  became  apparent  as  to  which 
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Military  Rank  category  a  foreign  officer  belonged.   Proper 
corresponding  ranks  should  be  outlined  in  any  future  polling 
of  this  sort.   It  was  discovered  that  the  options  under 
Curricular  Area  were  not  mutually  exclusive.   An  attempt  was 
made  to  correct  the  above  errors  by  examining  the  ballot  con- 
cerned.  Such  errors  were  not  used  as  a  basis  for  ballot  re- 
jection. 

The  most  common  cause  for  rejection  of  a  ballot  was  the 
requirement  that  the  voter  be  acquainted  with  at  least  five 
faculty  members  listed  as  eligible  teachers.   This  require- 
ment was  established  since  the  committee  felt  that  each  voter 
should  be  acquainted  with  at  least  a  certain  minimum  number 
of  teachers  in  order  to  make  a  meaningful  comparison.   The 
number  five  seemed  reasonable.   It  would  exclude  most  first 
quarter  students  but  very  few  of  the  others.   This  rejection 
principal,  although  resulting  in  a  "void"  ballot,  could  not 
be  considered  an  error  on  the  part  of  the  voter  and  conse- 
quently, was  not  a  function  of  ballot  format.   The  requirement 
was  not  publicized  on  the  ballot,  however. 

Two  other  major  causes  of  rejection  were  late  ballots  and 
multiple  selections  for  first,  second,  and  third  place  votes. 
After  a  certain  date,  late  ballots  could  no  longer  be  consid- 
ered in  the  selection  process  and  therefore  became  void. 
Also,  there  were  many  ballots  returned  blank  because  of  the 
lack  of  forwarding  addresses.   A  substantial  number  of  voters 
interpreted  the  procedure  instructions  to  mean  that  multiple 
choices  for  first,  second,  or  third  place  nominations  were 
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acceptable;  thus,  future  clarification  of  this  mis-interpre- 
tation is  needed.   Table  I  summarizes  the  void  ballots.   Late 
ballots  consisted  of  alumni  ballots  received  in  the  mail  too 
late  for  processing. 

TABLE  I 
Void  Ballot  Summary 

A.  Late  ballots 

Valid  20 

Void  2 

Blank  (Returned  37 
to  sender) 

B.  Pop.  <  5       -        .         171 

C.  Multiple  Nominations  24 

There  were  102  3  valid  ballots  used  in  the  selection  process. 
The  results  of  the  poll  would  become  more  representative  and 
the  statistical  findings  more  meaningful  with  a  reduction  in 
the  number  of  void  ballots. 
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III.   POPULATION  CHARACTERISTICS 

A.   RESPONSE  STATISTICS 

One  of  the  most  interesting  and  important  population 
characteristics  concerned  the  degree  of  voluntary  participa- 
tion the  Teaching  Award  could  arouse.   In  order  to  ascertain 
the  level  of  interest  reached  by  the  voter  population,  basic 
response  statistics  were  compiled.   These  statistics  were 
based  only  on  valid  ballots;  ballots  that  were  free  from  the 

errors  listed  above  and  had  M.  >  5  ,  where   M.   was  the  size 

1  —    '  1 

of  the  population  of  teachers .identified  by  the   it*1   voter. 

Response  by  Voter  Category  gave  general  response  statis- 
tics.  Table  II  gives  a  two-way  classification  of  the  Student 
ballots  received.   Each  interior  entry  in  the  table  represents 
the  number  of  ballots  received  from  the   i^h  Military  Rank 
of  the   jth   Curricular  Area.   The  top  row  is  a  count  of  those 
Student  ballots  listing  only  a  Curricular  Area.   Similarly, 
the  left-hand  column  represents  those  ballots  known  only  by 
Military  Rank.   The  bottom  row  gives  the  percentage  response 
within  each  Curricular  Area.   In  review,  from  the  14  85  stu- 
dents at  the  Postgraduate  School  when  the  poll  was  conducted, 
728  responded  in  an  acceptable  manner,  yielding  an  overall 
response  of  49%. 

Table  III  shows  a  similar  response  for  the  Alumnus  ballots 
Each  interior  entry  represents  the  number  of  ballots  received 
from  the   ith  Military  Ranking  of  the   jth   Curricular  Area. 
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TABLE  II 
Response  by  Student  Voter  Category 


Student  Curricular  Area 


Ops 
Ana 

Aer 
Eng 

Ele 
Eng 

Ord 
Eng 

Nav 
Eng 

Eng 
Sci 

Man 
CSc 

Env 
Sci 

Bac 

Pgm 

Def 

Man 

4 

1 

9 

9 

4 

8 

3 

0 

2 

0 

R 

01 

0 

9 

6 

7 

5 

9 

5 

14 

2 

4 

0 

61 

02 

1 

0 

1 

3 

1 

3 

1 

1 

0 

0 

0 

11 

03 

0 

54 

25 

57 

25 

17 

44 

4  8' 

1 

30 

0 

301 

Military 
Rank 

04 

2 

41 

10 

27 

23 

15 

39 

48 

0 

49 

1 

265 

05 
06 

0 

6 

0 

1 

1 

1 

1 

22 

0 

21 

1 

54 

1 

0 

0 

1 

0 

3 

0 

0 

0 

1 

0 

6 

S 
T 

114 
256 

43 
68 

105 
153 

64 
120 

52 

79 

98 
119 

136 
319 

3 
80 

107 
291 

2 

36 

U 

45 

63 

69 

53 

66 

82 

43 

4 

37 

6 

P  Students  known  in  Curricular  Area  only 

Q  Students  known  in  Military  Rank  only 

R  Student  Ballot  Distribution  by  Rank 

S  Total. Response  by  Curricular  Area 
T     Total  Enrollment  of  Each  Area 

U  Percentage  Response  by  Curricular  Area 
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TABLE  III 
Response  by  Alumnus  Voter  Category 


Student  Curricular  Area 


Military 
Rank 


Ops 
Ana 

<\er 
Sng 

Ele 

Eng 

3rd 

Eng 

Nav 
Eng 

Eng 
Sci 

Man 
CSc 

Env 
Sci 

Bac 
Pgm 

Def 

Man 

\a 

B  \ 

1 

1 

0 

0 

0 

1 

1 

0 

0 

0 

C 

01 

0 

1 

0 

1 

0 

0  " 

0 

2 

0 

1 

0 

5 

02 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

03 

1 

1 

0 

4 

3 

1 

3 

6' 

1 

1 

0 

21 

04 

1 

14 

L2 

11 

19 

12 

21 

16 

1 

20 

1 

128 

05 

1 

8 

2 

2 

0 

0 

5 

12 

0 

15 

1 

46 

06 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

2 

D 

.  25 

15 

19 

22 

13 

30 

38 

2 

37 

2 

A  Alumnus  known  by  Curricular  Area  only 

B  Alumnus  known  by  Military  Rank  only 

C  Alumnus  ballot  distribution  by  Rank 

D  Total  response  by  Curricular  Area 
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The  top  row  and  left-hand  column  have  the  same  meaning  as 
above.   The  bottom  row  is  the  total  response  from  the   jtn 
Curricular  Area.   Since  there  were  two  ballots  that  did  not 
indicate  a  Military  Rank  or  Curricular  Area,  the  total  Alumnus 
response  was  208  ballots.   There  were  530  ballots  mailed, 
yielding  a  return  of  39%. 

It  should  be  noted  that  the  polling  of  Alumni  poses  some 
difficult  problems.   They  must  be  contacted  by  mail,  and  hence 
a  listing  of  current  addresses  is  needed.   This  need  can  be 
served,  to  a  large  part,  by  the  use  of  Reference  2  and  the 
associated  data  tape  which  contains  a  list  of  previous  gradu- 
ates.  There  are  shortcomings,  however: 

(a)  The  tape  contains  listings  of  former  officer 
students  restricted  to  Naval  personnel  who  are  still 
active.   Moreover,  the  tape  requires  periodic  up- 
dating to  keep  the  addresses  reasonably  current. 

(b)  The  addresses  contained  on  the  tape  are  coded. 
These  must  be  translated  into  addresses  that  are 
usable  in  the  mail  system.   Such  can  be  accomplished 
with  the  aid  of  References  7  and  8,  but  experienced 
personnel  are  required  to  do  this. 

Experience  suggests  that  at  least  two  months  lead  time  are 
needed  to  update  the  tape,  and  at  least  one  month  to  translate 
the  addresses. 

Table  IV  shows  the  response  of  the  Faculty  ballots.   Each 
interior  entry  represents  the  ratio 


#  of  ballots  in  the  i,jtn  category  . 
total  |  possible 
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TABLE  IV 
Response  by  Faculty  Voter  Category 

Academic  Department 


Aca. 
Rank 


Aer 
Enq 

Avi 
Sty 

Man 
CSc 

Ele 
Enq 

Gov 
Hum 

Ma 

Mec 

Enq 

Mr 

Oc 

Dps 

Ana 

Phy 

Slav 

Mat 

\  E 
F  \ 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Pro 

0 

2 
7 

0 
0 

2 

4 

3 
20 

0 
3 

3 

13 

0 
8 

0 
3 

2 

4 

0 

T 

8 
14 

0 
4 

3 
10 

Ace 

0 

2 
7 

1 
2 

2 
8 

6 
19 

0 
3 

3 
6 

1 
2 

1 

4 

1 
2 

2 
12 

2 

13 

0 
3 

0 
3 

Ass 

0 

1 
3 

0 

1 

2 

6 

0 

0 

4 

4 
5 

1 
6 

3 
3 

2 
6 

4 
16 

2 

s 

0 
1 

0 
1 

Ins 

0 

1 
2 

1 
2 

0 
8 

1 
3 

0 
.2 

2 
12 

0 
1 

0 

3 

0 
2 

0 

4 

0 
3 

0 
R 

0 

o 

G 

7 
19 

3 

5 

6 
26 

10 

T6 

0 
12 

12 

36 

2 

17 

4 
13 

5 

14 

6 

36 

12 

35 

0 
1  6 

3 

TT 

H 

37 

60 

23 

22 

0 

33 

12 

31 

36 

17 

34 

0 

21 

E  Faculty  known  in  Academic  Department  only 

F  Faculty  known  in  Academic  Rank  only 

G  Total  response  by  Academic  Department 

H  Percentage  response  of  Academic  Department 

thus,  it  is  the  fractional  response  by  Academic  Rank  from 
each  Department.   The  top  row  and  left-hand  column  again  have 
the  same  interpretation  as  above.   The  bottom  row  gives  the 
percentage  response  within  each  Academic  Department.   There 
were  four  (4)  ballots  received  that  did  not  list  an  Academic 
Rank  or  Department;  thus,  the  total  response  from  the  Faculty 
was  74  ballots  out  of  289.   The  overall  response  of  the 
Faculty  was  25.6%^  ~ 

Of  the  ten  Curricular  Offices,  a  total  of  three  ballots 
was  received. 
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Of  the  102  3  valid  ballots  used  by  the  selection  committee 
the  Voter  Categories  represented  the  following  percentages: 


Curricular  Office            % 3% 

Alumnus  20  3% 

Faculty  1.2% 

Student  71  -^ 
Unknown 


1 
1.1% 


B.   DISTRIBUTION  ANALYSIS  OF   Nu   AND   M. 

k        i 

In  a  further  attempt  to  better  understand  the  voter 
population,  two  characteristics  were  of  interest.   Associated 
with  each  ballot  was  the  number  of  teachers  identified  by 
that  ballot,  and  associated  with  each  teacher  was  the  number 
of  voters  identifying  him.   To  gain  this  understanding, 
analyses  on  these  two  characteristics  were  made. 

Figure  1  is  a  histogram  of  Nj<  ,  the  number  of  voters 

identifying  the   fcth   teacher.   The  average  value  of  N 

k 
was  64.5,  with  a  standard  deviation  of  49.4. 

Figure  2  shows  a  frequency  distribution  of  M.   for 
the  Faculty  voters  only;  where   M.   is  the  numbc/of  teachers 
identified  by  the   ith   voter.   Similarly,  Figure  3  is  a 
distribution  of  M.   for  all  the  voters. 

It  is  interesting  to  note  the  high  average  of  the  Faculty 
ballots,  32.1,  when  compared. to  that  of  15.5  for  all  the 
ballots.   Undoubtedly  the  faculty's  criteria  for  "being  ac- 
quainted" with  a  teacher  are  different  from  those  of  the 
students . 
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C.   DISTRIBUTION  ANALYSIS  OF   DR 

Since  an  option  was  left  to  the  voter  whether  or  not  to 
add  a  supporting  statement,  it  was  desired  to  know  how  the 
voter  population  reacted.   The  following  analysis  was  made 
with  this  objective  in  mind. 

Define   X..,   to  be  the  number  of  ballots  awarding  a  first 
place  nomination  to   T,  ,  and   D,   to  be  the  number  of  these 
that  add  a  supporting  statement.   Figure  4  is  a  scatter  dia- 
gram of   PR  vs.  Xlk  ,   Xlk  >  5  ,  where   Pk  =  DkAlk  ,  the 
proportion  of   X,,   that  voluntarily  added  a  comment. 

To  estimate  the  probability  that  a  supporting  statement 
was  made,  a  "pooled"  value  of   P,   resulted  in 


P-  I   V  Ixlk-  .341 


Examining  Figure  4,  it  would  be  difficult  to  conclude 
that   Pk   was  in  any  sense  approximately  constant,  or  that 
any  correlation  coefficient  other  than  zero  would  fit  the 
observed  data.   It  was  concluded  that  the  probability  of 
receiving  a  supporting  statement  was  independent  of  the 
number  of  first  place  votes. 
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IV.   DATA  SUMMARY 

The  following  is  a  summary  of  the  data  utilized  by  the 
committee  in  the  selection  process.   Each  row  represents  the 
pertinent  data  for  a  single  teacher,  and  is  ranked  from  top 
to  bottom  in  order  of  decreasing  score,  where  teacher   k's 
score  is  defined  to  be 


sk  =  vk  •  w  , 


and 


W   is  the  weighting  vector  analyzed  below.   N,   and   D. 


are  as  defined  above,  and  X.,  ,   i  =  1,2,3   are  the  number 
of  first,  second,  and  third  place  nominations  received  by 
teacher   k  . 
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k 

\ 

S 

\ 

h* 

f2k 

f3k 

1 

2.36207 

58 

11 

28 

10 

5 

2 

2.35593 

59 

15 

30 

8 

3 

3 

2.33019 

106 

17 

54 

13 

5 

4 

2.21154 

52 

8 

24 

6 

7 

5 

2.01099 

91 

16 

40 

8 

7 

6 

1.78082 

73 

3 

22 

17 

8 

7 

1.74074 

27 

4 

7 

8 

3 

8 

1.73333 

120 

11 

41 

15 

14 

9 

1.71429 

42 

7 

14 

7 

2 

10 

1.68539 

89 

9 

25 

21 

8 

11 

1.61842 

76 

8 

19 

19 

9 

12 

1.51852 

81 

12 

24 

11 

5 

13 

1.41538 

130 

11 

34 

18 

12 

14 

1.35616 

73 

7 

18 

10 

7 

15 

1.29927 

137 

10 

27 

28 

14 

16 

1.28205 

39 

0 

9 

6 

2 

17 

1.28000 

50 

2 

13 

4 

4 

18 

1.27778 

18 

-  0 

4 

3 

1 

19 

1.24590 

61 

1 

14 

7 

6 

20 

1.18868 

53 

5 

9 

8 

11 

21 

1.18182 

44 

4 

8 

9 

2 

22 

1.13115 

61 

5 

12 

8 

5 

23 

1.02913 

103 

6 

15 

19 

8 

24 

1.00000 

51 

1 

7 

9 

5 

25 

0.97826 

92 

5 

18 

7 

4 

26 

0.97826 

92 

3 

15 

13 

4 

27 

0.96629 

89 

5 

14 

13 

4 

28 

0.96262 

107 

6 

16 

14 

11 

29 

0.94444 

36 

2 

5 

6 

2 

30 

0.90625 

64 

4 

7 

11 

8 

31 

0.88889 

45 

3 

7 

4 

4 

32 

0.87850 

107 

2 

12 

14 

18 

33 

0.86111 

72 

2 

9 

11 

4 

34 

0.85714 

7 

1 

1 

1 

0 

35 

0.85000 

20 

1 

3 

2 

1 

36 

0.84444 

90 

4 

12 

11 

6 

37 

0.82759 

58 

1 

8 

5 

6 

38 

0.80000 

15 

0 

2 

2 

0 

39 

0.78049 

41 

2 

3 

6 

8 

40 

0.77686 

121 

4 

10 

22 

10 

41 

0.77273 

44 

1 

8 

0 

2 

42 

0.77228 

101 

4 

13 

9 

8 

43 

0.76471 

17 

0 

2 

2 

1 

44 

0.76000 

50 

1 

7  - 

4 

2 

45 

0.74783 

115 

5 

14 

9 

12 

46 

0.72222 

144 

4 

14 

13 

22 

47 

0.71698 

106 

3 

13 

9 

6 

48 

0.71429 

49 

3 

5 

4 

7 

49 

0.68254 

63 

4 

6 

8 

3 

50 

0.68212 

151 

6 

14 

16 

15 

30 


Dk  xlk  X2k  x3k 


51 

0.66102 

59 

2 

5 

6 

7 

52 

0.65000 

20 

1 

2 

2 

1 

53 

0.64474 

76 

5 

7 

7 

7 

54 

0.59677 

124 

5 

16 

4 

2 

55 

0.59494 

79 

0 

4 

11 

9 

56 

0.58065 

62 

2 

6 

5 

2 

57 

0.57143 

28 

1 

1 

2 

8 

58 

0.56364 

55 

2 

4 

6 

3 

59 

0.54545 

11 

0 

1 

1 

0 

60 

0.53846 

52 

1 

4 

4 

4 

61 

0.52830 

53 

0 

3 

6 

4 

62 

0.52632 

57 

3 

5 

3 

4 

63 

0.52500 

40 

0 

2 

5 

3 

64 

0.52174 

138 

6 

13 

7 

6 

65 

0.51064 

47 

0 

2 

6 

4 

66 
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1 

4 

4 

1 

67 
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0 

0 
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0 

68 
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0 
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1 

69 
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1 

6 

11 

10 

70 
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78 

0 

5 

3 

9 

71 
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79 

2 

5 

5 

5 

72 
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41 

2 

2 

4 

2 

73 
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53 

0 

4 

1 

5 

74 
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44 

0 

3 

3 

1 

75 
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28 

0 

2 

2 

0 

76 
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7 

0 

0 

1 

1 
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0 

3 

7 
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78 
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2 
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1 

0 

79 
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0 
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7 

80 
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45 

0 
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4 

81 
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38 

0 

2 

3 

1 

82 
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59 

0 

4 

2 

3 

83 
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31 

0 

1 

1 

6 

84 
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52 

0 

3 

2 

4 

85 
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2 

11 

21 

24 

86 
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69 
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2 
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10 

87 
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88 

1 

4 

2 

13 

88 

0.37255 

51 

2 

2 

4 

3 

89 

0.37209 

43 

1 

1 

5 

2 

90 

0.37179 

78 

1 

2 

6 

9 

91 

0.37037 

27 

0 

2 

0 

2 

92 

0.36735 

49 

2 

3 

2 

2 

93 

0.36585 

82 

2 

2 

6 

10 

94 

0.36000 

75 

2 

3 

5 

5 
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1 
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75 

0 

3 

3 

8 

97 
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120 

0 

1 

12 

13 

98 
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97 

1 
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6 

5 

99 
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0 
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5 

4 
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3 

5 

2 

3 
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sk 

\ 
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V.   SPECIAL  ANALYSES 

The  following  special  studies  were  conducted  in  order  to 
objectively  choose  a  worthy  recipient  and  also  to  gain  know- 
ledge concerning  the  distribution  of  positive  scores. 

A.   DOMINANCE  CONCEPT  AND  SCREENING  RATIONALE 

1.  Background 

In  this  section,  a  concept  of  dominance  is  developed 
and  discussed  which  served  as  a  powerful  screening  criterion 
leading  to  the  final  selection  of  the  award  winner. 

Let  T,   represent  teacher  k   and  N,   represent 
the  number  of  voters  indentifying  teacher  k   on  their  ballots 
Define   X.,   as  above.   Now,  let   V.,  =  X../N,  ,  i  =  1,2,3 

IK  IK      IK   K 

represent  the  fraction  of  first,  second,  and  third  place  votes 
awarded  to   T    from  the  population  that  knew  him.   Therefore, 
each  teacher  has  a  return  vector,   V,  =  (^iv^ouVu)   which 
will  be  used  to  measure  his  excellence  as  a  teacher.   Table  V 
is  a  display  of   V,   for  the  top  25  teachers. 

2 .  Development 

Teacher   k's   score,   S,  ,  can  now  be  represented  by 

3 

s.  =    y  w.v., 

k    ,£-  i  lk 


■  WlVlk  +  W2V2k  +  W3V3k  (1> 
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TABLE    V 
Return   Vector      V, 


Ik 


2k 


3  k 


1 

0.48276 

0.17241 

0.08621 

2 

0.50847 

0.13559 

0.05085 

3 

0.50943 

0.12264 

0.04717 

4 

0.46154 

0.11538 

0.13462 

5 

0.43956 

0.08791 

0.07692 

6. 

0.25926 

0.29630 

0.11111 

7 

0.30137 

0.23288 

0.10959 

8 

0.28090 

0.23595 

0.08989 

9 

0.34167 

0.12500 

0.11667 

10 

0.33333 

0.16667 

0.04762 

11 

0.25000 

0.25000 

0.11842 

12 

0.29630 

0.13580 

0.06173 

13 

0.26154 

'  0.13846. 

0.09231 

14 

0.24658 

0.13699 

0.09589 

15 

0.19708 

0.20438 

0.10219 

16 

0.22222 

0.16667 

0.05556 

17 

0.23077 

0.15385 

0.05128 

18 

0.26000 

0.08000 

0.08000 

19 

0.16981 

0.15094 

'  0.20755 

20 

0.22951 

0.11475 

0.09836 

21 

0.18182 

0.20455 

0.04545 

22 

0.19672 

0.13115 

0.08197 

23 

0.14563 

0.18447 

0.07767 

24 

0.13725 

0.17647 

0.09804 

25 

0.19565 

0.07609 

0.04348 

where  W  =  (w, ,w2,w  )   is  a  weighting  vector  to  be  specified 
later. 

In  general,   W   is  subject  to  the  constraint  that 


w,  >  w2  >  w3  >  0 


(2) 


It  would  be  non-sensical  to  'give  more  weight  to  either  a 
second  or  third  place  vote  than  to  a  first  place  vote.   Con- 
sequently, from  (2)  above, 
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and 


0  <  w2/w,  <  1 


0  <  w3/w„  <  1 


(3) 


A  further  restriction  is  necessary  since  values  of  w2/wi 
and  w_/w2   too  near  zero  or  unity  are  also  undesirable. 
This  would  mean  that  either  a  second  or  third  place  vote  re- 
ceived a  weight  of  zero,  or  that  they  are  weighted  equally 
with  a  first  or  second  place  vote,  respectively.   Therefore, 
the  inequalities  in  (3)  above  can  be  rewritten 


and 


0  <  a1  <_   w2/w1  <_  b,  <  1 


0  <  a„  <_   w  /w2  <_  b2  <"  1  . 


(4) 


Thus,   (a, ,b,)   and   (a~,b„)   define  a  preferential  region 
interior  to  the  unit  square.   Figure  5  shows  -such  a  preferen- 
tial region  when   a,  =  -a2  =  1/3   and  b,  =  b2  =  2/3  . 


FIGURE  5 


Preferential  Region  For 

a2  =  1/3   and  b±   =  b2  =  2/3 
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The  shaded  region  represents  points  satisfying  the  general 
constraints  in  (3)  above.   The  smaller  square  area   DEFG 
depicts  the  preferred  region  where  the  ratios   w^/w,   and 
W3^W2   satisfy  the  constraints  in  (4) .   The  region  outside 
the  larger  square   OABC   violates  the  inequalities  in  (2) 
and  (3)  above. 

Concepts  of  dominance  will  now  be  developed.  Let  k 
and  k1  denote  any  two  teachers.  It  is  desired  to  find  all 
possible  values  of  W   so  that 

sk  >  sk,  . 

Therefore , 

WlVlk  +  W2V2k  +  W3V3k  i-   wlVlk'  +  W2V2k'  +  W3V3k' 


Wl<Vlk  "  Vlk'>  +  W2(V2k  *  V2k'>  +  W3(V3k  "  V3k'>  1  °  "   (5) 

The  first  form  of  dominance  becomes  obvious  from  (5) 
above.   When   V.,  -  V.,,  >  0  ,  i  =  1,2,3  ,  then   Sk  >  Sk, 
and   S  ,   can  be  eliminated  from  competition.   This  form  of 
dominance  is  termed  absolute  dominance.   (See  Table  V). 

Another  form  of  dominance  is  readily  generated 
following  the  observation  that  (5)  defines  a  straight  line  in 
the  two  dimensional  space  of' Figure  5.   From  (5), 

£l(Vlk  "  Vlk'>  +  (V2k  "  V2k'»  +  £r(V3k  -  V3k''  >    ° 


and 


38 


w3  >  _   Vlk  "  Vlk'   w,     V2k  "  V2k' 


w*  "    V3k  "  V3k'   W2     V3k  -  V3k' 


(6) 


where   V.,  ,   V.,,  ,  i  =  1/2,3   are  known.   The  set  (6)  can 
be  simplified  to 


W2  —  kk '  W2     kk 


(7) 


where   A,,  ,   and   B  ,  ,   are  known  constants.   Consequently, 
the  set  (7)  defines  a  half-space  in  which   S,   dominates   S, 


S,  >  S 


Case  IV 


Case  III 


i — i — * — i  ^ 


FIGURE  6 
Case  Examples'  of  Dominance.. 


Figure  6  is  a  plot  of  ™3/™2      vs '   w]/w2  *   Converting 
the  old  limits"  of  w  /w    to  new  limits  for  w-|/w2   yields 
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1  <  3/2  <_  w1/w2  £  3  <  °°  (8) 

These  limits  are  plotted  in  Figure  6,  together  with  four 
cases  of  dominance. 

In  Case  I,  all  the  points  that  are  feasible,  those 
that  satisfy  (2)  and  (3)  above,  lie  in  the  half-space  where 
Sk  >  Sk'  *   This  is  termed  complete  dominance.   Absolute 
dominance  is  observed  to  be  a  special  case  of  complete  domi- 
nance.  Case  III  may  be  called  incomplete  dominance;  that  is, 
where   S,  >  S,  ,   over  portions  of  the  feasible  region,  but 
not  any  of  the  preference  region.   In  Case  IV,  the  points 
necessary  for   S   >  S,  ,   are  infeasible,  resulting  in   sk's 
elimination  from  competition.   Case  II  represents  the  most 
interesting  situation.   In  this  case,  both   S,   and   S,  ,  have 
the  feasible  and  preferential  ability  to  eliminate  the  other 
depending  on  the  selected  weight  system. 
3.   Results 

In  the  actual  data,  only  thirteen  teachers  out  of  249 
remained  after  an  initial  screening  for  absolute  dominance. 
A  secondary  screeing  for  complete  dominance  reduced  the  group 
to  four.   A  final  screening  for  incomplete  dominance  further 
reduced  the  eligible  teachers  to  a  group  of  three. 

Figure  7  shows  the  results  of  this  analysis.   Let 
T,  ,   T2  /   and   T-   be  the  teachers  surviving  the  dominance 


screening  criteria.   From  the  data,   S,  >  S„ 
Sti  >  .73  £!   -   1.04  . 

W2  W2 


when 
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FIGURE  7 
Results  of  Dominance  Techniques 

This  region  is  represented  by  the  trapezoidal  figure   ABCD 
Similarly,   S2  >  S    when 

£l  >  .25  ^LL  -  3.61 

W2  W2 


and   si  >  S3   when 


w3 
w2 


>  .68  511  -  1.21 

,W2 


These  dominance  lines  generated  areas  where  T^    ,   T2  '   and 
T^   could  win- the  poll  based  on  score  alone,  given  that  the 

point   ~ ,~|   fell  into  their  respective  regions.   Several 

c  \   W2  W2- 
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further  analyses  of  the  data  were  made  in  an  effort  to  choose 
among  the  three  undominated  teachers. 

B.   PRINCIPAL  COMPONENT  ANALYSIS  —  DETERMINATION  OF  WEIGHTS 
1.   Background 

For  purposes  of  preliminary  analysis  of  the  data,  it 
was  convenient  to  use  tentative  weights  for  first,  second, 
and  third  place  votes,  and  to  rank  the  teachers  according  to 
the  resulting  scores.   Several  sets  of  weights  were  suggested 
by  the  Selection  Committee  (such  as   3:2:1   and   4:2:1)   and 
ultimately  the  system   4:2:1  was  chosen  for  use  in  the  dis- 
tribution and  correlation  studies.   This  selection  was  in- 
fluenced by  the  following  analysis. 

It  is  reasonable  to  choose  weights  that  would  maximize 
the  variance  of  the  scores.   This  would  facilitate  ranking  the 
teachers  in  a  preferred  order  and  reduce  the  number  of  scores 
very  close  together.   In  two  dimensions,  a  teacher's  score 
could  be  represented  by   S  =  w, x,  +  w?x„  ,  which  when  graphed, 
becomes  a  straight  line  in  the   (x,  ,x„)   space.   Figure  8  is 
such  a  plot. 

In  three  dimensions,  these  lines  become  planes  and 
the  objective  in  either  case  is  to  spread  these  lines  or 
planes  as  far  apart  as  possible.   The  method  of  principal 
components  was  used  to  obtain  the  set  of  weights  that  would 
accomplish  this  objective. 
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VVi 


FIGURE 


Two-Dimensional  Plot  of   (x,  ,x«)  . 


2.   Development 

Teacher   k's   score,   S,  ,  can  be  represented  by 

\  -  J1wivik  ■  w  •  \  • 

where   W   is  the  desired  weighting  system.   The  objective  is 
to  choose   W   so  as  to   Max|Var(S  )|  .   Since  the  scores 
could  be  made  arbitrarily  large  by  letting   W  be  unbounded, 
a  constraint  on  W   is  needed  to  solve  the  mathematical  prob- 
lem.  It  is  convenient  to  use  the  form 


WW  =  1 
to  constrain  the  weight  vector. 


(9) 
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Define   V  =  (V,  ,V2,V.J  ,  where   V.   is  the  average 
value  of  the  fraction  of  first,  second,  and  third  place  votes 
taken  over  all  teachers , 

Mo 


V-  =  ^-      J  V..  ,   i  =  1 
1   Mo  k^  ik 


,2,3 


and  where  M0   is  the  total  number  of  teachers  identified  by 
the  ballots.   The  variance  of  the  scores  can  be  written 


Var(Sk)  =  w1  C  W  ,  (10) 

where   C   is  the  square,  symmetric  variance-covariance  matrix 
of  the   V.,'s  ,  i.e. 


:.  .  =  E  (V.,  -  V.  )  (V.,  -  V.) 
ij  L  ik    i'  3k  j'j 


i,j  =  1,2,3 
V  k  . 


Combining  the  objective  function  and  the  constraint 
on  W   into  the  classical  Lagrangian  for  the  maximization 
problem  yields 

L(W,X)  =  W'  C  W  -  X(W'  W  -  1)  ,  (11) 

where   X   is  the  Lagrange  multiplier.   Equation  (11)  can  be 
rewritten  to  facilitate  obtaining  the  partial  derivatives, 
3    3  3 

l(w,x)  =    y     y  w.c.w.  -  x(  y  w2  -  i)  .  (12) 

j=l  i=l  1  ^    3      i=l  x 

Taking  the  partial  derivatives  with  respect  to   W 
and   X   and  setting  them  equal  to  zero  to  obtain  the  maximizing 
value  of  W  yields: 


44 


^(W,X)  =  2  C  W  -  2  X  W  =  0  (13a) 

d  W 


and  3L(W,A)  =  w-  w  -  1  =  0  .  (13b) 

Rearranging  (13a)  ,   (C  -  XI)  •  W  =  0  ,  results  in  a  system  of 
3X3  linear,  homogeneous  equations.   Their  solution  is  either 
trivial,   W  =  0  ,  or  the  coefficient  matrix  is  singular, 

|C  -  Xl|  =  0  .  (14) 

It  should  be  noted  that  (14)  is  the  characteristic  equation, 
a  third  degree  polynomial  in   X  ,  where  the   X's   now  also 
represent  eigenvalues  associated  with  the  covariance  matrix. 
From  (13a)  above, 

C  W  =  X  W  , 

and   Var(S  )  =  W*  C  W 

=  W'  X  W  =  X  W'  w  , 

and  using  (13b),   Var(S,)  =  X  .   Thus,  it  follows  that 
Var(S,  )   is  maximized  when   X   is  maximized,  and  that  the 
set  of  weights  maximizing   X   is  the  eigenvector  associated 
with   X  .   Therefore,  utilizing  as  the  weighting  system  the 
eigenvector  associated  with  the  largest  eigenvalue  of  the 
characteristic  equation,  results  in  a  system  that  separates 
the  scores  as  much  as  possible. 
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A  fundamental  fault  with  this  approach  concerns  the 
satisfaction  of  the  general  and  preferential  restrictions 
on   W  .   There  is  no  guarantee  that  w,  >  w2  >  w^   will  occur 
or  that  the  inner  restrictions   (a, ,b  )   and   (a2,b2)   will 
be  satisfactory. 
3.   Results 

From  the  data  collected, 

.0087    .0035    .0017 

|  .0035    .0035    .0015 

.0017    .0015    .0021 

The  largest  eigenvalue  is  X   =  .011  ,  and  the  associated 
eigenvector  is   W  =  ( . 86  ,  .  45  ,  . 24)  .   This  vector  was  modified 
to  the  simpler  form  W  =  (4,2,1)  .   Since  both  general  and 
preferential  limits  were  satisfied,   (4,2,1)   was  used  to 
weight  first,  second,  and  third  place  votes  with  the  added 
knowledge  that  the  resulting  scores  would  be  relatively  well 
spread  apart. 

C.   PAIRED  COMPARISONS  ANALYSIS 

A  special  study  was  conducted  on  the  top  twenty  teachers , 
where  the  top  twenty  was  defined  to  be  the  twenty  highest 
scoring  teachers.   This  study  consisted  of  comparing  each 
pair  of  the  twenty.   For  each  pair,  the  score  was  based  only 
on  that  sub-population  of  voters  that  identified  both  teachers 

Define   T,,T2,  .  .  .,  T20   to  be  the  top  twenty  teachers 
ranked  in  decreasing  order  of  score.   In  this  paired  compari- 
son analysis,   T,   would  be  expected  to  win  over  all  others, 
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and  T2Q   would  be  expected  to  lose.   If  T.   lost  in  any  of 
these  tests,  significant  argument  might  be  made  for  giving 
the  award  to  another  high  ranking  teacher,  say  T„   or   T~  . 

Again,  let   k   and   k'   denote  any  two  teachers  and  now 
let  N,  ,  ,   be  the  size  of  the  population  of  voters  knowing 
both  teachers.   Clearly,   ^Nkik^  "  ^kk'^  =  N  *   Table  VI 
is  a  display  of  the  square,  symmetric  matrix  N  . 

Define  a  new  score,   S,,  ,  ,  to  be  the  score  of  teacher  k 
based  on  the  sub-population,   {N,,  ,}  .   Similarly,  let   S,  ,, 
be  the  score  of  teacher  k1   based  on   {N.,  i)  .   Table  VII 
is  the  square  matrix  of   S,  ,  ,  -  .   In  general,   S^it,  ^   S,  ,  , 
and  the  matrix  in  Table  VII  is  not  symmetric. 

Table  VIII  shows  the  results  of  such  a  paired  comparison 
analysis  for  the  top  five  teachers  ranked  as  described  above. 
Looking  at  the  analysis  for  T..  ,   N,,  ,   is  defined  as  above, 
T,   is  the  teacher  with  whom  T..   is  being  compared,  s-\/s\li 
is  the  ratio  of   S,,/Skl  ,  where   S,,   and   S,,   are  defined 
as  above,  and  the  plus  sign  is  interpreted  to  mean  that 
S,  >  S,  ,  and  a  minus  to  indicate  a  reversal,  meaning   S   <  S.. 
It  is  significant  to  note  that  T.   loses  twice  and  ties  once 
under  such  an  analysis. 

The  importance  of  the  size  of  N,  ,  ,   was  noted  by  the 
selection  committee,  and  consequently,  only  reversals  that 
occurred  with  larger  values  of  N,,,   were  considered  relevant. 
Table  VIII  is  ranked  under  each  teacher  by  order  of  decreasing 
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TABLE  VII 

S   MATRIX 

1                2              3  45              67             8              910 

1  0.0  0.0  1.26  2.00  0.0  2.00   2.77   0.0    0.0    0.0 

2  0.0  0.0  1.23  4.00  0.57  0.0    1.14   3.65   2.15   0.0 

3  3.26  0.46  0.0  1.33  0.55  2.0C 

4  1.00  0.0  0.0  0.0  1.00  0.0 

5  0.0  0.57  0.64  2.00  0.0  2.0( 

6  2.00  0.0  1.33  0.0  0.50  0.0 

7  1.69  0.14  0.09  0.67  0.0  0.0 

8  0.0  1.29  0.75  0.0  0.0  0.0 

9  0.0  0.38  0.50  0.0  1.00  0.0 

10  0.0  0.0  0.0  0.0  3.00  0.0 

11  1.17  1.33  2.00  1.50  0.0  0.0 

12  0.75  0.0  0.45  0.50  1.50  0.29   0.13   6.0    0.0    0.0 

13  0.0  0.0  1.00  2.00  1.29  0.0    1.20   4.00   0.75   0.56 

14  0.41  0.0  0.73  0.0  0.0  0.50   0.0    2. 00   3.33   0.0 

15  0.20  0.0  0.53  0.0  1.31  0.0    0.44   2.00   0.0    0.0 

16  0.0  0.0  4.00  0.91  0.0  0.0    1.00   0.0    2.00   0.0 

17  0.0  0.0  0.0  0.50  0.0  0.0    1.39   0.0    0.0    0.0 

18  0.0  0.0  0.45  2.00  0.40  0.93   0.29   0.0    0.0    0.0 

19  0.0  0.0  0.67  0.0  0.73  0.0    0.0    0.0    0.0    0.0 

20  0.0  0.0  0.0  0.0  1.50  1.00   0.0    1.50   0.0    0.25 


0.91 

0.0 

0.50 

2.00 

0.83 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

2.00 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.78 

1.00 

0.0 

0.0 

0.67 

0.50 

0.0 

0.0 

0.0 

0.0 

0.0 

1.00 

0.0 

0.0 

0.0 

0.33 

0.67 

0.67 
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TABLE  VII  (CONT'D) 

S  MATRIX 
14     15     16     17     18     19     20 


1 

0.50 

3.00 

0.0 

0.94 

4.00 

2.00 

0.0 

2.67 

0.0 

0.0 

2 

1.33 

1.33 

0.0 

0.0 

0.67 

0.0 

1.00 

1.00 

0.0 

0.0 

3 

0.0 

2.29 

1.50 

3.47 

0.53 

0.0 

0.67 

1.85 

0.0 

0.0 

4 

2.33 

0.0 

0.0 

4.00 

0.0 

2.00 

1.25 

0.0 

0.0 

0.0 

5 

0.0 

0.17 

1.75 

4.00 

2.03 

4.00 

0.0 

0.0 

0.80 

1.00 

6 

0.0 

2.29 

0.0 

1.70 

0.0 

0.0 

0.0 

1.87 

0.0 

0.0 

7 

0.0 

0.13 

0.20 

0.0 

0.33 

1.00 

1.85 

0.14 

0.0 

0.0 

8 

0.0 

0.0 

0.0 

0.50 

0.0 

0.0 

1.00 

0.0 

0.0 

1.03 

9 

3.44 

0.80 

2.25 

0.33 

0.83' 

1.00- 

0.0 

0.0 

0.0 

0.20 

10 

1.33 

0.0 

2.00 

3.00 

2.00 

0.0 

0.0 

0.0 

0.0 

1.00 

11 

0.0 

0.0 

0.67 

1.38 

0.0 

0.50 

2.00 

0.0 

0.0 

2.00 

12 

0.0 

0.0 

0.25 

2.00 

2.30 

0.0 

0.33 

0.65 

2.91 

0.0 

13 

0.0 

0.0 

0.0 

0.80 

0.88 

0.0 

0.0 

0.0 

0.0 

1.20 

14 

0.13 

0.50 

0.0 

0.0 

2.00 

0.0 

0.0 

0.0 

0.0 

0.0 

15 

0.0 

1.15 

1.12 

0.0 

0.0 

0.0 

0.0 

0.29 

1.82 

0.0 

16 

2.00 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

17 

0.0 

0.0 

0.0 

0.0 

0.0 

0.67 

0.0 

0.0 

0.0 

0.0 

18 

0.0 

1.09 

0.67 

0.0 

0.29 

0.0 

0.67 

0.0 

0.0 

0.0 

19 

0.0 

0.55 

0.0 

0.0 

1.20 

0.0 

0.0 

0.0 

0.0 

0.0 

20 

0.13 

0.0 

1.60 

0.0 

0.0 

0.0 

0.0 

1.00 

0.0 

0.0 

50 


H 
H 

g 

> 

CO 

M 

g  hm 

<J1 

£ 

H 

o 

C_) 

+1 

+ 

+ 

+ 

1 

+ 

o 

1 

1 

1 

+ 

+ 

CO 

n 

o 

cn 

in 

CM 

"Jo 

r-J    m 

stlm 

in  in 

o 

o 

o 

St 

o  o 

o 

o 

O 

m 

o 
o 

O 

O 

o 

o 

m 

o  o 

CO 

CM 

1-1 

r"1 

7-1 

' 

In 

' 

' 

I . — 1 

1 

1-1 

H 

CM 

** 

CM 

' 

m 

CO 
r-l 

o> 
I-I 

CM 

r-l 

CO 

CM 

l-» 

00 

o> 

r-. 

r-l 

o 

CM 

St 

\D 

00 

CM 

00 
CM 

m 

CM 

H 

h» 

m 

m 

st 

St 

St 

CM 

CM 

CM 

+  1 

+ 

+ 

+ 

+ 

1 

i 

1 

i 

1 

1 

A! 

CO 

st 

CO 

CO 
CO 

CM 

O 

LO 
r-l 

Olr-< 

OJcr. 

CM| 

colf-- 

00  ko 

mlo 
cm  in 

i — 1 1 

o 

CO 

co 

olo 
o  o 

r-l|cM 

o 

o 
m 

o 

o 
o 

CM 

o 

o 

o 
o 

r-l 

O 
O 

CM 

1° 
° 

o     • 

o 

o 

O    O 

O    O 

H* 

r-l 

r-l 

h* 

r-l 

CO 

m 

CM 

r-l 

CO 

1—1 

m 

I—l 

CM 

vr> 

00 

o 
r-l 

st 

CM 

r-l 

i— 1 

vD 

St 

CO 

CM 

CM 

CM 

CM 

+  1 

+ 

+ 

+ 

+ 

o 

1 

1 

"   + 

o 

+ 

1 

+ 

+ 

+ 

CO 

co 

CO 

cMm 

CM    St 
Cm| 

mlm 
00  st 

r-i| 

CM 
CO 

vO 
CM 

St 

co 

CO 

CO 

m 

ro 
m 

St 

CO 
CM 

r-l 

m 

IT) 

st 

i-ilcr. 
cr>  o 

m  m 

|-» 

o 

|m 
or-- 

o 
m 

r-l 

o 

o 

r-l 

CO 
CO 

r-l 

o 

o 

o 

CM 

co 

CO 

CM 

00 

i-l 

St 

r-l 

m 

r-l 

CM 

m 

r^ 

o> 

h- 

00 

CO 
r-l 

St 

vO 

**5 

CO 

53 

00 
CO 

o 

CM 

o> 

m 

m 

CO 

!-< 

r-i 

00 

vO 

st 

St 

CO 

CO 

+  1 

+ 

+ 

+ 

o 

+ 

+ 

+ 

+ 

+ 

O 

+ 

r* 

CO 

CM 
CO 

mlcjN 

VD    CM 
CO|i-l 

COlvO 
CM  1st 

■ — i  f 

r-l 

CM 

CO 
CO 

in  m 

st  1st 

r-l    r-l 
< — 1  | 

CO 

co 

r-l 

o 

o 

o 
o 

r-l 

o 

o  o 

r-l| 

CO 
CO 

r-l 

CO 
CO 

r-l 

o  o 

°l 

o  o 

O 

o 

o 

o 

H* 

00 

CO 

o> 

m 

r— 

CM 

in 

r- 

CO 

r-l 

r-i 

st 

CO 
r-l 

o 

CM 

.a 

CM 

55 

r-» 

CO 

I-I 

CO 
r-l 

r*> 

r» 

\D 

vD 

st 

St 

CO 

r-l 

r-i 

rH 

r-l 

+  1 

1 

+ 

+ 

i 

+ 

+ 

+ 

o 

+ 

+ 

CO 
r-l 

CM    CM 

CM  St 

r^|cr> 
r»|vo 

m 

O    CM 

olm 

o 

olo 
o  o 

o 

o 

O 

o 

O 

o 

O 

o 

o 

o 

o 

O    O 

CO 

i-l|cO 

1 

CM|rH 

r-l 

<t| 

co| 

CN 

CM|CM 

CM 

n 

CM 

' 

H* 

<o 

St 

r-» 

r-l 
r-i 

m 

r-l 

CM 
r-l 

00 
r-l 

v£> 

CM 

<t 

r-l 

r-l 

o 

CM 

i-i 

2; 

r-l 

l*o 

CO 

i—l 

\o 

m 

St 

CO 

CM 

i-l 

- 

r-l 

r-^ 

r-l 

51 


+1 

' 

+      + 

co 

OIO 

o  o 

O 

O 

o 
o 

Ol 

o  °.  o 

CO 

cm|co 

<± 

<l"l 

o 

.-i 

i— 1 

r-l            r-t 

55 

CM 

CM 

t-l            r-* 

+  1 

+ 

. 

J* 

CO 

-■^ 

CO 

O 

o 

o 

O 

o 
o 

CM 

<J- 

00 

r-l 

55 

l-l 

r-l 

+  1 

. 

■              + 

1 

a: 

CO 

co 

CO 

o 

v£5 

O 

o 

lo  o 
o  o 

o      ♦      • 
|CM   CM 

o 

o     • 

H* 

CT> 

o 

CM 

r-l         o 
t-l        t-l 

I-l 

CO 

55 

CO 

CO 

CM           t-< 

r-» 

+1 

t* 

CO 

CM 
CO 

CM 

55 

+  1 

^2 
CO 

T-l 

CO 

- 

H* 

i— i 
55 

a 

o 

o 

(D 

cu 

CO 

CO 

o 

rl 

M 

a 

c 

c 

o 

o 

•h 

•r-l 

0 

o 

is 

5 

w 

co 

w 

•i-i 

r* 

to 

CO 

M-l 

n 

P 

•H 

•H 

r* 

0) 

0." 

60 

,M" 

M 

M 

u 

u 

•H 

^! 

0) 

CD 

CO 

CO 

01 

W 

A!. 

X 

XI 

0) 

QJ 

•r-l 

55 

U 

0 

O 

4-i 

4J 

4-1 

»> 

<D 

CO 

CO 

^ 

II 

J3 

CD 

CD 

<+-i 

cw 

m 

CI 

o 

4J 

4-1 

•r-l 

•H 

•H 

tfl 

rt 

X 

0 

+ 

1 

o 

X> 

^! 

4-1 

55 

X 

II 

CO 

|| 

II 

X 

•r-l 

1 

55 

H 

CO 

.+  1 

olc 

52 


D.   SCATTER  DIAGRAM  ANALYSIS  OF   S,    VS.   N. 

k         k 

An  analysis  was  conducted  on  the  relationship  between 
S,   and  N,  ,  where   S,   was  the  score  received  by  teacher  k 
and  N,   was  the  voter  population  familiar  with  teacher  k. 

It  would  be  ridiculous  to  give  the  award  to  the  teacher 
who  received  a  perfect  score  because  one  person  knew  him  and 
nominated  him  for  first  place.   Thus,  in  this  analysis,  it 
was  desired  to  identify  a  subgroup  of  high  scores  that  were 
associated  with  small  N,  ,  if  any  existed;  and  if  so,  exclude 
these  from  competition.   Figure  9  is  a  scatter  diagram  of 
S,   vs.   N,  .   From  the  diagram,  it  was  concluded  that  this 
problem  did  not  exist  and  therefore,  a  procedure  for  dissecting 
this  space  into  two  half-spaces,  one  that  would  be  acceptable 
for  further  analysis  and  one  that  would  be  eliminated,  was 
not  researched. 

Another  purpose  of  this  analysis  was  to  determine  if  any 
correlation  of   S,   with  N,   could  be  made,  either  positively 
or  negatively.   If  it  could  be  concluded  that  the  regression 
coefficient  did  not  equal  zero,  then  it  would  have  been  neces- 
sary to  find  a  different  function  of  the  polling  data  to  serve 
as  the  score,  one  that  was  not  correlated  with  N,  . 

Figure  9  again  demonstrated  that  no  correlation  could  be 
made  and  that  the  regression  coefficient  required  would  be 
zero,  thus  rendering  the  preceding  analyses  valid. 
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FIGURE  9 
Scatter  Diagram  of   S   vs.  N, 


54 


E.   SCORE  DISTRIBUTION  ANALYSIS 

Another  special  study  was  concerned  with  a  determination 
of  the  distribution  of  the  positive  scores.  With  this  know- 
ledge, probability  statements  and  analyses  could  be  made  to 
a  high  degree  of  accuracy.  The  first  step  in  this  direction 
was  the  construction  of  a  histogram  of  S,  (see  Figure  10) . 
The  histogram  showed  that  the  scores  have  a  reverse-J  shaped 
distribution.  To  estimate  the  form,  the  empirical  tail- 
distribution  was  computed.  The  results  are  printed  in  Table 
IX,  where 

N  is  the  number  of  positive  scores 

f.  is  the  frequency  of  the   jth   scoring-cell, 

TF  is  the  tail  frequency, 

and  RTF  =  TI/N  is  the  relative  tail  frequency. 

From  Table  IX,  a  semi-logarithmic  plot  of  score-cell  mid- 
point against   RTF  was  examined.   Figure  11  was  the  resulting 
plot  and  it  was  concluded  that  a  straight  line  could  be  mean- 
ingfully fitted  to  the  data.   Letting 

y  =  RTF 
and      x  =  score-cell  midpoint, 

lo9-i0  y  =  ~  «909x  ,  and  converting  to  the 

natural  logarithm, 

.434  In  y  =  -  .909x 

or    .     In  y  =  -2.09x       ~ 

-2  09x 
and  therefore,    y  =  e        .   Consequently, 

—  2  09x 
P(X  >  x)  =  e   "     ,  and  this  would  yield  an  estimated 
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FIGURE    10 
Histogram  of      S, 
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TABLE  IX 
EMPIRICAL  TAIL-DISTRIBUTION  DATA 
Cell        Cell  Mp 


1 

.001 

- 

.1 

.050 

2 

.101 

- 

.2 

.150 

3 

.201 

- 

.3 

.250 

4 

.301 

- 

.4 

.350 

5 

.401 

- 

.5 

.450 

6 

.501 

- 

.6 

.550 

7 

.601 

- 

.7 

.650 

8 

.701 

- 

.8 

.750 

9 

.801 

- 

.9 

.850 

10 

.901 

- 

1.0 

.950 

11 

1.001 

- 

1.1 

1.050 

12 

1.101 

- 

1.2 

1.150 

13 

1.201 

- 

1.3 

1.250 

14 

1.301 

- 

1.4 

1.350 

15 

1.901 

- 

1.5 

1.450 

16 

1.501 

- 

1.6 

1.550 

17 

1.601 

- 

1.7 

1.650 

18 

1.701 

- 

1.8 

1.750 

19 

1.801 

- 

1.9 

1.850 

20 

1.901 

- 

2.0 

1.950 

21 

2.001 

- 

2.1 

2.050 

22 

2.101 

- 

2.2 

2.150 

23 

2.201 

- 

2.3 

2.250 

24 

2.301 

- 

2.4 

2.350 

F. 
_1 

TF 

RTF  (if) 

InRTF 

42 

163 

.7955 

-.2295 

34 

129 

.6295 

-.4630 

23 

106 

.5170 

-.6600 

27 

79 

.3855 

-.9550 

13 

66 

.3218 

-1.1350 

13 

53 

.2585 

-1.3500 

5 

48 

.2342 

-1.4500 

11 

37 

.1805 

-1.7130 

7 

30 

.1463 

-1.9200 

7 

23 

.1122 

-2.1900 

1 

22 

.1073 

-2.2400 

3 

19 

.0927 

-2.3800 

5 

14 

.0683 

-2.6850 

1 

13 

.0634 

-2.7600 

1 

12 

.0586 

-2.8400 

1 

11 

.0537 

-2.9200 

2 

9 

.0439 

-3.1300 

4 

5 

.0244 

-3.7200 

0 

5 

.0244 

-3.7200 

0 

5 

.0244 

-3.7200 

1 

4 

.0195 

-3.9300 

0 

4 

.0195 

-3.9300 

1 

3 

.0146 

-4.2400 

3 

0 

.000  . 

00 

N  =  205 
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FIGURE  11 


Semi-Logarithmic  Plot  of  Score-Cell  Midpoint  vs.   RTF 
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density  function  of   S,   to  be 

fs(s)  =  2.09e"2*09s  ,   s  >  0  (15) 

The  smooth  curve  on  Figure  10  is  a  plot  of  this  density 
function. 

It  was  desired  to  test  the  statistical  validity  of  this 
density  function  as  a  true  representation  of  the  data.   A 
Chi-Square  Goodness-of-Fit  Test  was  chosen.   Table  X  is  a 
collection  of  the  data  used  in  the  Goodness-of-Fit  test  for 

HQ:   fs(s)  =  2.09e'2*09s  ,   s  >  0 
H,  :   H   false,  where 

I  ,1  ,  .  .  .  ,  I  .   represent  the  scoring  intervals, 

p.  =  P(S  e  I.)   under   H_  ,   Np.   is  the  expected  number  of 
entries  in   I.   under   Hft  ,   and   x.   is  the  number  of  ob- 
served entries  in   I .  . 

l 

k   (x   -  Np  )2 
Define   U  =    Y   - ,   where   U   is  a  ran- 

iii      np± 

dom  variable  that  approaches  the  Chi-Square  Distribution  func- 
tion with   k-2   degrees  of  freedom  as   n-*°°  .   Then,   H_ 
should  be  accepted  with  probability  of  Type  I  error  equal  to 
a  ,  if  the  observed  value  of  U  , 


u  <  xk-2(1  "  a) 
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TABLE  X 
Chi-Square  Goodness-of-Fit  Test  Data 


P(S  e  Ii) 


under   H, 


Np. 


1 

(sk|sk  <  .1} 

.188 

38.6 

42 

2 

{Sk| .1  <  Sk  <  .2} 

.153 

31.4 

34 

3 

{Sk|.2  <  Sk  <  .3} 

.124 

25.4 

23 

4 

{Sk| .3  <  Sk  <  .4} 

.101 

20.7 

27 

5 

.081 

16.6 

13 

6 

.067 

13.7 

13 

7 

.054 

11.1 

5 

8 

.043 

8.8 

11 

9 

.035 

7.2 

7 

10 

{Sk| .9  <  Sk  <  1.0} 

.030 

6.2 

7 

11 

{Sk| 1.0  <  Sk  <  1.2} 

.042 

8.6 

4 

12 

{Sk|l.2  <  Sk  <  1.4} 

.028 

5.7 

6 

13 

{Sk|l.4  <  Sk  <  1.7} 

.025 

5.1 

4 

14 

{Sk|Sk  >-1.7} 

.029 

5.9 

9 
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2 
From  the  observed  data,   u  =  11.8  3  ,  and  from  the   x 

distribution  with  twelve  degrees  of  freedom  and  a   =  .05  , 
X^2  (.95)  =  21.0  .   Therefore, 

2 

u  <  Xt?  («95)   and  H0   is  accepted. 

Since  the  hypothesized  density  function  passed  the  Chi-Square 
Test,  it. was  concluded  that  (15)  above  was  an  acceptable  des- 
cription of  the  observed  scores . 

F.   CORRELATION  ANALYSIS 

The  correlation  analyses  below  were  designed  to  aid  future 
committees  by  providing  a  better  understanding  of  the  voter 
population. 

1.   Coefficient  of  Concordance  Analyses ' 

Appendix  B  is  a  display  of  data  used  to  estimate  the 
effect  of  age  of  the  voters.   It  was  desired  to  know  if  the 
ratings  of  the  teachers  were  somehow  dependent  upon  the  age 
of  the  individual  voter.   To  accomplish  this,  Kendall's 
Coefficient  of  Concordance  was  applied  to  the  ranking  of 
sixty-two  teachers  by  two  separate  subgroups  of  the  voter 
population.   Since  military  rank  is,  for  the  most  part,  pro- 
portional to  age,  it  was  felt  that  a  ranking  of  the  sixty- 
two  teachers  first  by  the   01' s  ,  and  secondly  by  the   04 's 
would  give  a  wide  enough  spread  in  rank  to  encompass  the 
effect  of  age  upon  voter  nominations.   Hence,  Appendix  B 
is  a  2x62  matrix,  where  the  first  row  represents  the  ranking 
of  teachers  by  the   01' s  ,  and  the  second  row  by  the   04 's  . 
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The  choice  of  sixty-two  teachers  was  made  because  of 
the  following  two  restrictions.   First,  it  was  necessary  to 
restrict  the  population  of  teachers  to  those  known  by  both 
observer  categories.   Secondly,  it  was  felt  necessary  to  put 
a  restriction  on   N,  ,  the  number  of  ballots  identifying 
teacher   k  ,  in  each  voter  category.   Consequently,  each  of 
the  sixty-two  teachers  eligible  for  ranking  were  known  by 
both  the   Oi's   and  the   04 's  ;  and  in  addition,  at  least 
five  ballots  from  the  population  of  Ol's   and  at  least  five 
from  the  o4's  identified  each  teacher. 

From  Kendall  [Ref .  3]  ", 

W  =  -ft-3 =T= — T^ — r '       0  <  W  <  1  , 

m2  (n3  -  n)  -  12m  £  T.        - 

where   W   is  the  Coefficient  of  Concordance  modified  to  com- 
pensate for  the  existence  of  ties  within  rankings.   The  ob- 
served data  yielded 


s 

= 

69,504 

m 

= 

2 

n 

= 

62 

Tl 

= 

781 

T2 

= 

182 

W 

= 

.89  . 

and 

The  statistic  W  measures  the  communality  of  judgment  be- 
tween the  two  rankings.   Thus,  a  W   close  to  one,  such  as 
the  above,  indicates  a  high  degree  of  concordance  between 
rankings,  and'  from  the  above  test,  it  can  be  concluded  that 
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age  was  not  an  important  factor  in  how  a  voter  rated  the 
teachers . 

At  this  point,  some  measure  of  the  significance  of 
this  observed  value  of  W   is  needed.   Such  a  measure  is 
offered  by  Kendall,  utilizing  the  Chi-Square  distribution. 
Define 

u-    12s 


mn(n  +  1) 


=  m(n  -  1)W  .   Then   U   is  approxi- 
mately  distributed  as   x2 (1  ~  a)   with   v  =  n  -  1  degrees 
of  freedom.   From  the  observed  data,  "u  =  108.5  .  Since 
v  =  61 (>  30)   degrees  of  freedom, 


^x^  *  N(ll,l) 


/2x2   -  11  *   N(0,1) 


or   (/2xz    -  11  >  z)  =  .01  ,  which  implies 


/2X2   -  11  >  2.23 


Thus,   x2  >    87.5   specifies  the  critical  region.   Therefore, 

6  1 

the  observed  value  of   U  , 

u  =  108.5  >  X2   =  87.5  ,  and  it  is  concluded 

that  the  resulting  W   above  is  substantially  significant. 

For  determining  the  effect  of  military  rank  on  voter 
choice,  a  Kendall  Coefficient  of  Concordance  was  computed  for 
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the  subpopulation  of  voters  consisting  of  the   03' s  ,   04' s  , 
and   05' s  ,  a  large  group  that  had  all  ranked  a  common  large 
number  of  teachers.   The  test  was  conducted  under  the  same 
restrictions  as  above.   Appendix  C  shows  the  3x91  matrix  of 
rankings.   These  data  yielded 

W  =  .82 
and      u  =  222  .   Consequently, 

u  =  222  >  x2   =  I22  i    and  therefore,  from 

9  0 

this  analysis,  it  was  concluded  that  Military  Rank  did  not 
influence  the  pattern  of  voter  nominations . 

A  Coefficient  of  Concordance  was  developed  for  the 
rankings  of  the  Faculty  and  those  of  the  Students.   It  was 
desired  to  know  if  the  Faculty  in  general,  would  vote  as  did 
the  Students.   Similar  restrictions  as  those  above  were  intro- 
duced to  obtain  more  meaningful  results.   Appendix  D  displays 
the  2x19  3  matrix  utilized  in  the  test,  with  the  following  re- 
sults : 

W  =  .73 
and       u  =  280  .   Consequently, 

u  =  280  >  Y2    =  238  ,  and   W  =  .73   is 

192 

"just  significant"  at   a  =  .01  .   Therefore,  it  was  concluded 
that  both  Students  and  Faculty  generally  agreed  on  their 
choices. 

Similarly,  it  was  desired  to  know  how  the  Alumnus  would 
compare  to  the  Faculty  in  such  a  test.   Appendix  E  displays  the 
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2x115  matrix  of  data.   Restrictions  such  as  those  above  were 
introduced  with  the  following  results: 

W  =  .65 

and       u  =  148  .   Consequently, 

u  =  148  <  v2    =  150  ,  and  it  was  concluded 
l  1  h 

that  W(=  .65)   was  not  significant  at   a  =  .01  .   In  other 

words,  it.  could  have  arisen  by  chance  from  a  population  where 

Faculty  and  Alumnus  were  completely  unrelated. 

The  tests  of  hypothesis  for  significance  had  as  the 

null  hypothesis  and  alternative, 

H  •   W   is  not  significant 

H, :   W   is  significant. 

At  times,  it  would  be  more  meaningful  to  know  the  value  of   a 
at  which  the  decision  regarding   H„   would  just  be  changing 
from  accept  to  reject,  given  the  test  statistic.   This  value 
of   a   is  called  the  P-value  [Ref.  1]  and  is  commonly  used 
as  a  substitute  for  the  critical  point.   Thus,   P  =  P  (W  _>  the 
observed  W) .   The  P-value  for  the  above  calculations  are 
determined  as  follows: 

Let  u*  be  the  observed  value  of  the  test  statistic. 
Then 

/2u*  -  y 


v 

%       =  zi  -  p-' 

where   u    and   a    are  the  mean  and  standard  deviation  of 
Kv        v 

the  Normal  distribution  approximation  of  the  Chi-Square  dis- 
tribution with   v  >  30  ,  and   z,       is  the   100(1  -  P) 
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:rcentile  of  this  Normal  distribution.   Now, 


1  -  P  -  Nz(Zl  _  p) 


and  P  =  1  -  Nz(Z;L  _  p)  ,  where  Nz(Z;L  _  p) 

is  the  value  of  the  cumulative  distribution  function  of  the 
Standard  Normal  at   z,  _    . 

The  results  of  the  Concordance  Analyses  with  their 
respective  P-values  are  summarized  in  Table  XI  below. 

TABLE  XI 
Coefficient  of  Concordance  Summary 

Observers 

01' s  and  04 's 
03's,  04's  and  05's 
Faculty  and  Students 
Alumnus  and  Faculty 

It  was  concluded  that  the  Faculty  and  Students ,  in 
general,  agreed  upon  their  choices  and  that  within  the  Students 
agreement  was  high  regardless  of  age  or  rank.   The  lower  value 
for  W  ,  although  not  significant  at   a  =  .01  ,  noted  in  the 
test  of  Alumnus  and  Faculty  would  indicate  that  graduate  views 
differ  from  current  Students  and  Faculty. 
2 .   Contingency  Table  Analyses 

It  was  desired  to  know  if  Academ: e  Rank  was  associated 
with  score.  A  contingency  table  was  developed  for  Score  Cate- 
gory vs.  Academic  Rank.  This  test  could  then  conclude  whether 
or  not  scoring  was  independent  of  the  rank  of  the  teachers 
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w 

P-Value 

.89 

lO"4 

.82 

<  10-4. 

.73 

<  10-4 

.65 

.018 

concerned;  and  consequently,  whether  or  not  the  voter  popu- 
lation favored  one  or  more  of  the  teacher  categories.   There- 
fore, it  was  desired  to  test 


Hn:   P.  .  =  w. s . 

against   Hn  :   P. .  ^  w.s.  ,  where 

1     lj  '   1  j  ' 

Pij  =  P(Tk  £    (i'3)th  cell) 

w.  =  P (T   e  i  score  category) 

and   s .  =  P (T,  e  j  academic  rank)  . 
D       K 


TABLE  -XII 
Contingency  Table  For 
Score  Category  vs.  Academic  Rank 


Academic  Rank 


Score 
Category 


Prof 

Acco 

Asst 

Inst 

total 

.0001 
.1200 

16 
16.0 

14 
17.3 

10 
13.2 

8 
6.6 

48 

.1201 
.2400 

11 
11.1 

10 
12.0 

11 
9.2 

5 
4.6 

37 

.2401 
.4300 

10 
13.5 

21 

14.7 

10 
11.2 

4 
5.6 

45 

.4301 
.7300 

12 
8.  8 

5 
9.5 

9 
7.2 

3 
3.6 

29 

.7301 
4.000 

14 
13.5 

13 
14.7 

12 
11.2 

6 
5.6 

""45 

total 

63 

68 

52 

26 

204 

67 


Table  XII  displays  the  data  in  a  contingency  table. 
Each  interior  cell  has  two  entries.   The  upper  entry  repre- 
sents the  observed  number  of  teachers  of  academic  rank   j 
scoring  in  score  category   i  .   The  lower  entry  of  each  cell 
is  the  number  of  entries  that  should  be  in  the  cell  if   H 
is  true.   These  numbers  were  found  using  the  maximum  likeli- 
hood estimators  for  w.   and   s.   [Ref.  4]: 

i         3 


1   I 
W.  =  =■      I    X.  .  ;   i  =  1,2,3,4,5 


j-i  ° 


and    S  .  =  -   7  X .  .  ;'j  =  1,2,3,4 
D    n  i=l  1=> 


X. .   is  the  number  of  observed  entries  in  each  cell.   Thus, 
ID 

from  n   sample  values  , 


nW.S.  =  expected  number  of  entries 
in  the   (i,j)th   cell. 


5    4  (X.  .  -  nW.S .)2 
Therefore,      V  =  I         I 


i=l  j=l    nW.S . 
J        i  3 

is  approximated  by  the  Chi-Square  distribution  function  with 
twelve  degrees  of  freedom.   From  the  observed  data, 

v  =  10.2 


and     x   (-95)  =  21.0 

1  2 


Since  v  <  y2  (-95)  ,   Hn   is  accepted  with 

1  2  U 
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probability  of  Type  I  error,   a  =  .05  .   It  was  concluded 
that  the  scoring  distribution  was  independent  of  Academic  Rank 
and  that  the  voter  population  did  not  prefer  any  academic  rank 
in  particular. 

A  word  should  be  said  concerning  the  score  categories 
used  above.   It  was  desired  to  have  score  categories  such  that 
each  would  encompass  an  equal  number  of  expected  entries;  and 
in  addition,  that  the  expected  number  be  greater  than  or  equal 
to  five.   To  achieve  this,  the  exponential  distribution  esti- 
mated previously  was  used,  through  its  inverse  function,  to 
arrive  at  five  scoring  intervals. 

TABLE  XIII 
Contingency  Table  For 
Score  Category  vs.  Student  Curricular" Area 


Score 

Category 


Ops 
Ana 

Ele 
Eng 

Ord 
Eng 

Nav 
Eng 

i^ng 
Sci 

Man 
CSc 

Bac 
Pgm 

total 

.0001 

.1200 

9 
7.0 

8 
8.7 

7 
7.6 

6 
5.7 

12 
8.8 

5 
8.8 

6 
6.5 

53 

.1201 
.2400 

7 
8.2 

9 

10.1 

9 
8.9 

6 
6.1 

11 
10.  3 

9 
10.3 

11 
7.7 

62 

.2401 
.4300 

9 
10.7 

13 
13.2 

10 
11.7 

5 
8.6 

14 
13.4 

19 
13.4 

11 
10.0 

81 

.4301 
.7300 

10 
11.0 

17 
13.5 

18 
1-2.0 

11 
8.9 

9 
13,7 

10 
13.7 

8 

10.2 

83 

.7301 
4.000 

22 

20.0 

23 

24.6 

18 
21.8 

18 
16.2 

25 
25.0 

28 
25.0 

17 
18.5 

151 

total 

57 

70 

62 

46 

71 

71 

53 

430 

69 


A  similar  analysis  was  made  on  Score  Category  vs. 
Student  Curricular  Area.   Table  XIII  shows  the  resulting 
contingency  table.   Conclusions  as  to  the  independence  of 
score  category  and  individual  student  curricula  were  of 
interest. 

The  test  statistic  now  becomes 

5    7   (X. .  -  nW.R.)2 


i=l  j=l    nW.R. 
J        i  3 


where   R.   is  the  maximum  likelihood  estimator  of   r.  ,  the 
2  3 

probability  of  falling  in  the  "  j  curricular  area.  Thus 
V  is  approximated  by  the  Chi-Square  distribution  function 
with  twenty-four  degrees  of  freedom.   From  the  observed  data 

v  =  18.6 


X2  (.95)  =  36.4 

2  «♦ 


Since  v  <  x2  (.95)  ,  the  null  hypothesis  of 

2  «* 

independence  is  accepted  with   a  =  .05  . 

It  was  concluded  that  score  category  was  independent 
of  student  curricular  area,  in  that  the  probability  of  re- 
ceiving a  score  in  one  of  the  categories  was  not  dependent 
upon  which  student  curricula  were  sampled. 

Due  to  exceptionally  low  voter  response  in  three  cur- 
ricular areas,  only  seven  curricula  were  represented  in  this 
analysis.   It  is  to  be  noted  that  the  contingency  table 
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analyses  are  specific  to  the  scoring  intervals  chosen.   Time 
constraints  precluded  deeper  analyses  of  these  potential 
associations . 

It  was  desired  to  perform  a  Contingency  Table  Analysis 
on  Score  Category  vs.  Academic  Department.  Conclusions  as  to 
whether  or  not  the  scoring  distribution  was  independent  of 
academic  department  were  of  interest.  Table  XIV  is  a  collec- 
tion of  data  for  such  an  analysis.  Due  to  the  small  expected 
and  observed  numbers  involved,  the  analysis  was  not  conducted, 
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VI.   CONCLUSION 

Members  of  the  Selection  Committee  made  individual  eval- 
uation of  the  special  studies  presented  above  in  preparation 
for  their  final  choice  of  an  award  recipient.   Following  a 
presentation  of  the  special  studies,  the  committee  cast  a 
secret  ballot  to  choose  among  the  remaining  three  teachers. 

The  names  of  individual  teachers  concerned  were  unknown 
to  the  Selection  Committee  throughout  the  process.   At  the  time 
the  above  ballot  results  were  revealed,  the  only  name  announced 
was  that  of  the  winner.   His  name  was . forwarded  to  the  Academic 
Dean  and  Superintendent,  and  will  be  made  public  at  the  June 
Graduation  Ceremonies. 
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APPENDIX  A 
SAMPLE  BALLOT 
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AWARD  FOR  EXCELLENCE  IN  TEACHING 
-  Background  - 


In  order  to  augment  the  existing  incentives  for  teaching  of  high  quality,  the 
Superintendent  has  established  an  award,  called  the  Award  for  Excellence  in  Teaching.  Having 
participated  in  the  educational  processes  at  the  Naval  Postgraduate  School,  your  opinion  is 
of  value  to  the  Selection  Committee.  In  order  to  assess  the  collective  opinion  of  students, 
faculty,  staff,  and  selected  alumni,  the  committee  is  conducting  this  poll.  After  accumulating 
the  voting  results  the  committee  will  select  the  Award  recipient. 

The  committee,  mindful  of  the  many  measures  of  teaching  excellence,  does  not  wish 
to  fix  the  rationale  by  which  each  voter  determines  his  nominations.  However,  in  order  to 
assist  those  voters  who  desire  something  more  definite  as  a  guide  to  their  thinking,  the 
committee  offers  the  following  summary  of  some  aspects  of  teaching  excellence  worthy  of 
consideration:  "The  phrase,  'excellence  in  teaching,'  refers  to  that  complex  of  personal  and 
professional  qualities  and  actions  on  the  part  of  the  teacher  which  (a)  make  themselves  felt 
primarily  at  the  interface  of  personal  contact  between  student  and  teacher;  (b)  help  transmute 
the  student's  encounters  with  his  subject  matter  into  insight,  enlightenment  and  love  of 
learning;  (c)  elicit  from  the  student  responses  in  thought,  feeling  and  action  which  enhance 
his  capacity  for  self  education  and  (d)  manifest  themselves  in  an  effective  individual  style 
which  authentically  reflects  the  teacher's  own  unique  personality,  experience,  character, 
and  convictions." 

A  meaningful  selection  of  the  Award  recipient  is  heavily  dependent  upon  the  receipt 
of  nominations  from  a  large  portion  of  the  eligible  "voters."  Your  response  is  therefore 
earnestly  requested.  Please  complete  the  enclosed  ballot  in  accordance  with  the  attached 
instructions.  The  results  of  the  polling,  other  than  the  Award  recipient,  will  be  treated 
as  privileged  information  by  the  committee. 

BALLOTING  PROCEDURE: 

Step  0.  Complete  the  information  requested  at  the  top  of  the  ballot.  These  items  are  for 
purposes  of  statistical  analyses  only. 

Step  1.  On  the  list  of  eligible  faculty  encircle  the  number  at  the  left  of  those  with  whom 
you  are  sufficiently  acquainted  to  make  a  judgment.  Use  your  own  guidelines.  For 
purposes  of  establishing  a  population  base,  it  is  important  to  encircle  all  with 
whom  you  are  acquainted. 

Step  2.  From  the  subset  of  faculty  you  have  indicated  in  Step  1,  select  from  one  (1)  to 
three  (3)  nominees.  Indicate  the  order  of  your  preference  by  placing  a  number  1, 
2,  or  3  opposite  and  to  the  left  of  the  appropriate  name.  Numeral  "1"  indicates  the 
first  choice,  etc. 

Step  3.  You  are  invited  to  furnish  a  short  statement  in  support  of  your  primary  nomination. 
Space  is  provided  for  this  at  the  and  of  the  ballot. 

Step  4.  Return  the  ballot  by  April  7. 

Students:  Return  to  your  curricular  officer. 

Faculty  and  Staff:  Send  to  Code  55  Bal . 

Alumni:  Return  via  the  enclosed  return  envelope. 
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Part  I  -  Statistical    (encircle  code  at  left) 


Voter  Category 

Milita 

ry 

ich  of  Service 

Curricular  Area 

Navy 

30 

Ops  Analysis 

Marine  Corps 

31 

Aero  Eng 

Army 

32 

Elec  &  Comm  Eng 

Coast  Guard 

33 

Ordnance 

Air  Force 

34 

Naval  Eng 

Foreign 

35 

Env  Sci 

36 

Manage  &  Comptr  Sci 

3/ 

Eng  Sci 

38 

Baccalaureate 

39 

Def  Management 

S  Student 

F  Faculty 

A  Alumnus 

C  Curricular  Officer 


Rank 

Department 

IR 

Instructor 

AE 

Aeronautics 

AT 

Assist  Prof 

AO 

Aviation  Safety 

AC 

Assoc  Prof 

MN 

Bus  Ad  &  Econ 

PR 

Professor 

EE 

Elec  Eng 

GH 

Govt  &  Humanities 

MC 

Mat  Sc  &  Chem 

MA 

Math 

ME 

Mech  Eng 

MR 

Meteorology 

OC 

Oceanography 

OA 

Ops  Analysis 

PH 

Physics 

NS 

Navy  Manage  Sys  Centei 

Part  II   -  List  of  Eligible  Faculty  (all   faculty  engaged 
chairmen  and  members  of  the  selection  committee) 


teaching  in  the  academic  year  1969-70  except  department 


Aviation  Safety  Programs 

1014     Bomberger,  R.   B. 

1025     Bradbury,  CM. 

1036     Fletcher,  J.   L. 

1047     Wible,  L.   C. 

Department  of  Aeronautics 

1058  Ball  ,  R.  E. 

__  1069  Bennett,  J.  A.  J. 

1070  Biblarz,  0. 

1081  Collins,  D.  J. 

1092  Delph,  T.  J. 

1108  Haupt,  U. 

1119  Kahr,  C.  H. 

__  1120  Layton,  D.  M. 

1131  Lindsey,  G.  H. 

1142  Miller,  J.  A. 

1153  Netzer,  D.  W. 

1164  Schmidt,  L.  V. 

1175  Vavra,  M.  H. 

1186  Zucker,  R.  D. 

Department  of  Business  Administration 
and  Economics 

1197  Carrick,  P.  M. 


1203  Castro,  B. 
1214  Church,  W.  H. 


1236  Darbyshire,  L. 

1247  Eisenhardt,  P. 

1258  Elster,  R.  S. 

1269  Fremgen,  J.  M. 

1270  Ganz,  J.  G. 
1281  Githens,  W.  H. 
1292  Hoverland,  H.  t 
1308  Jolly,  J.  A. 


1319  Lande,  R.  S. 

1320  Lane,  M.  L. 
1331  Lee,  M. 
1342  Musgrave,  G. 
1353  Senger,  J.  D 
1364  Steckler,  M. 

Wegener,  W. 
Womer,  N.  K. 


1375 


Department  of  Electrical  Engineering 

1397  Badger,  R.  R. 

1403  Bauer,  W.  M. 

1414  Baycura,  0.  M. 

1425  Borst,  F.  W. ,  Jr. 

1436  Bouldry,  J.  M. 

1447'  Breida,  S. 

1458  Campbell,  J.  D. 

1469  Chan,  S.  G. 

1470  Chaney,  J.  G. 

1481  Cooper,  P.  E. 

1492  Cotton,  M.  L. 

1508  De  Laura,  R.  D. 

1519  Demetry,  J.   S. 

1520  Ewing,  G.   D. 

1531  Gardner,  E.  M. 

1542  Gerba,  A.,  Jr. 

1553  Hoisington,  D.  V. 

1564  Houston,  R.  K. 

1575  Kirk,  D.  E. 

1586  Klamm,  C.  F. ,  Jr. 

1597  Marmont,  G.  H. 

1603  Miller.  R.  L. 

1614  Murray,  R.  P. 

1625  Myers,  G.  A. 

1636  Myers,  H.  L. 

1647  Oler,  C.  B. 


1658 

Parker,  S.  R. 

1669 

Sackman,  G.  L. 

1670 

Sheingold,  A. 

1681 

Smith,  W.  C. 

1692 

Stentz,  D.  A. 

1708 

Terman,  F.  W. 

1719 

Thaler,  G.  J. 

1720 

Turner,  J.  B. ,  Jr. 

1731 

Vivell,  A.  E. 

1742 

Ward,  J.  R. 

1753 

Wilcox,  M.  L. 

Department  of  Government 

and  Humanities 

_  1764 

Alexander,  W.  P. ,  Jr. 

1775 

Bjarnason,  L.  L. 

1786 

Gabel,  B.  B. 

1797 

Gottschalk,  S. 

1803 

Huff,  B.  F. 

1814 

McAdams,  J.  M. 

1825 

Pearson,  L.  W. 

1836 

Stolfi,  R.  H. 

1847 

Teti,  F.  M. 

Departmen 

t  of  Material  Science  and 

Chemistry 

1858 

Clark,  J.  R. 

1869 

Helliwell,  R.  W. 

1870 

Hering,  C.  A. 

1881 

Kinney,  G.  F. 

1892 

Marshall,  G.  D. 

1908 

McFarlin,  G.  H. 

1919 

Reynolds,  M.  F. 

1920 

Rowell.  C.  F. 

_  1931 

Schultz,  J.  W. 

1942 

Sinclair,  J.  E. 

1953 

Tolles,  W.  M. 

1964 

Wilson,  J.  W. 

76 


Department  of  Mathematics 

1975 

Barksdale,  G.  L. 

1986 

Bender,  A.  P. 

1997 

Bleick,  W.  E. 

2006 

Bolles.  R.  C. 

2017 

Brainerd,  W.  S. 

2028 

Calabrese,  P.  G. 

2039 

Davis,  D.  L. 

2040 

Deaton,  L.  W. 

2051 

Dixon,  D.  R. 

2062 

Estell.  R.  J. 

2073 

Faulkner,  F.  D. 

2084 

Giarratana,  J. 

2095 

Hunt,  R.  W. 

2101 

Jayachandran,  T. 

2112 

Jennings,  W. 

2123 

Kildall,  G.  A. 

2134 

Kodres,  U.  R. 

2145 

Kolitz,  B.  L. 

2156 

Little,  W.  A. 

2167 

Litzler,  L.  G. 

2178 

Lucas,  K.  R. 

2189 

Marks,  H.  B. 

2190 

Morris,  G.  W. 

2206 

Pierce,  J.  P. 

2217 

Preisendorfer,  R.  W. 

2228  Pulliam,  F. 


2240  Schwarzkopf,  A. 


2251 

Shorb,  A.  M. 

2262 

Singer,  E.  A. 

2273 

Spalding,  J.  1 

2284 

Stewart,  E.  J 

2295 

Trahan,  D.  H. 

2312  Wilde,  C.  0. 

Department  of  Mechanical  Engineer 

2323  Brock,  J.  E. 

2334  Cantin,  G. 

2345  Houlihan,  T.  T. 

2356  Kelleher,  M.  D. 

__  2367  Lynch,  E.  F. 

2378  Marto,  P.  J. 

2389  Newton,  R.  E. 

2390  Nguyen,  D.  H. 

2406  Prowell  ,  R.  W. 

2417  Pucci,  P.  F. 

2428  Tyvand,  N.  P. 

2439  Windrey,  R.  C. 

Department  of  Meteorology 

2440  Alberty,  R.  L. 

3476  Carrigan,  R.  C. 

2451  Duthie,  W.  D. 

2462  Elsberry,  R.  L. 


_  3487  Hamilton,  H.  D. 

_  2473  Mahlman,  J.  D. 

_  2484  Martin.  F.  L. 

_  3498  Oakes,  W. 

_  2495  Renard,  R.  J. 

_  2501  Taylor,  C.  L. 

_  2512  van  der  Bijl,  W. 

_  2523  Williams,  R.  T. 

Department  of  Oceanography 

_  2534  Andrews,  R.  S. 

_  2545  Boston,  N.  E.  J. 

_  2556  Crew,  H. 

_  2567  Denner,  W.  W. 

_  2578  Geary,  J.  E. 

_  2589  Giles,  C.  F. 

_  2590  Haderlie,  E.  C. 

_  2606  Jung,  G.  H. 

_  2617  Smith,  R.  J. 

_  2628  Thompson,  W.  C. 

_  2639  Thornton,  E.  B. 

_  2640  Tucker,  S.  P. 

_  2651  van  Schwind,  J.  J. 

_  2662  Wickham,  J.  B. 
Department  of  Operations  Analysis 

_  2673  Andrus,  A.  F. 

_  2684  Arima,  J. 

_  2695  Barr,  D.  R. 

_  2701  Barrett,  E.  B. 

_  2712  Burnett,  T.  D. 

_  2723  Burton,  R.  M. 

_  2734  Butterworth,  R.  W. 

_  2745  Connolly,  J.  P. 

_  2756  Cunningham,  W.  P. 

_  2767  Ferguson,  R.  L. 

_  2778  Floyd,  J. 

_  2789  Forrest,  R.  N. 

_   2790  Gieseke,  W.  J. 

_  2806  Greenberg,  H. 

_  2817  Heidorn,  G.  E. 

_  2828  Higgins,  J.  E. 

_  2839  Howard,  G.  T. 

_  2840  Jones,  C.  R. 

_  2851  Kochems,  R. 

_  2862  Larson,  H.J. 

_  2873  Lindsay,  G.  F. 

_  2884  Marshall,  K.  T. 

_  2895  McMasters,  A.  W. 

_  2901  Milch,  P.  R. 

_  2912  Peterson,  C.  A. 

_  2923  Poock,  G.  K. 

_  2934  Preston,  F.  L. 

_  2945  Schrady,  D.  A. 

_  2956  Schwartz,  H.  J. 

_  2967  Shubert,  B.  0. 


2978 

Shudde,  R.  H. 

2989 

Taylor,  J.  G. 

2990 

Tuck,  G.  A. 

3009 

Tysver,  J.  B. 

3010 

Woods,  W.  M. 

_  3021 

Zweig,  H. 

Department  of  Physics 

3032 

Armstead,  R.  L. 

3043 

Buskirk,  F.  R. 

3054 

Ceglio,  N.  M. 

3065 

Cooper,  A.  W.  M. 

3076 

Cooper,  J.  N. 

3087 

Coppens,  A.  B. 

3098 

Crittenden,  E.  C. ,  Jr. 

3104 

Dahl ,  H.  A. 

3115 

Dyer,  J.  N. 

3126 

Eller,  A.  I. 

3137 

Garrettson,  G.  A. 

3148 

Handler,  H.  E. 

3159 

Harrison,  D.  E. ,  Jr. 

3160 

Kalmbach,  S.  H. 

3171 

Kelly,  R.  L. 

3182 

Kinsler,  L.  E. 

3193 

Lipes,  R.  G. 

3209 

Medwin,  H. 

3210 

Milne,  E.  A. 

3221 

Olsen,  L.  0. 

3232 

Reese,  W. 

3243 

Riggin,  J.  D. 

3254 

Rodeback,  G.  W. 

3265 

Sanders,  J.  V. 

3276 

Schacher,  G.  E. 

3287 

Schwirzke,  F.  R. 

3298 

Williamson,  T.  J. 

3304 

Wilson,  0.  B. ,  Jr. 

_  3315 

Zeleny,  W.  B. 

Navy  Manaqement  Systems  Center 

.  3326 

Blandin,  S.  W. 

3337 

Cantrell ,  G.  K. 

3348 

Childs,  F.  E. 

3359 

Clark,  R.  G. 

3360 

Dawson,  J.  E. 

3371 

Doran,  E.  J. 

3382 

Freed,  E.  J. 

3393 

Kearns,  W.  A. 

3409 

Martin,  A.  J. 

3410 

Mauer,  W.  A. 

3421 

Netro,  R.  J. 

3432 

Plotkin,  N. 

3443 

Ulrey,  1.  W. 

3454 

von  Pagenhardt,  R. 

3466 

Wood,  C.  L. 

Part  III  -  Supporting  remarks  for  your  primary  nomination  (optional) 
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APPENDIX  B 
COEFFICIENT  OF  CONCORDANCE  DATA  FOR  01  's  AND  04' s. 


01 

30.5 

2 

52 

26.5 

26.5 

38 

30.5 

52 

04 

45 

4 

47 

28 

21 

40 

29 

56 

01    19      30.5    20.5    52      16       8.5    52      30.5     6.5 
04    56      10      25      27      13      19      56      30      11 


10 

11 

12 

13 

14 

15 

16 

17 

18 

01 
04 

14 

12 

52 

34 

20.5 
36 

52 

46 

5 
14 

52 
39 

36 

20 

4 

7 

18 
26 

19 

20 

21 

22 

23 

24 

25 

26 

27 

01 
04 

52 
35 

•  12 
5 

52 

38 

41 
56 

24 
41 

40 
56 

6.5 
16 

52 
49 

10 
9 

28 

29 

30 

31 

32 

33 

34 

35 

36 

01 

04 

52 
56 

34 
6 

11 
17 

8.5 
2 

22 
18 

23 
15 

52 
43 

52 

44 

39 
56 

37 

38 

39 

40 

41 

42 

43 

44 

45 

01 
04 

33 

48 

14 
8 

52 
42 

28 
23 

25 
22 

17 
31 

52 
56 

3 
3 

36 
32 

46 

47 

48 

49 

50 

51 

52 

53 

54 

01 
04 

1 
1 

52 
56 

36 
37 

14 
33 

52 

56 

52 
56 

52 
56 

52 
24 

52 
56 

55 

56 

57 

58 

59 

60 

61 

62 
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APPENDIX  C 
COEFFICIENT  OF  CONCORDANCE  DATA  FOR  03' s,  04' s,  AND. 05' s 


03  3  80.5  15  19  80.5  45  26  11.5  41.5 

04  2  74  47.5     9  19  32  36  17  27 

05  2  34.5     5  12  30.5  53  37.5  1  52 

10  11  12  13  14  15  16  17  18 

03  14  80.5  80.5  37  80.5  55  41.5  10  54 

04  10  85  85  40  85  85  59.5  15  61 

05  17  76.5  76.5  39  76.5  76.5  60  24.5  47 

19  20  21  22  23  24  25  26  27 

03  80.5  9  11.5     7  51  52  13  46  80.5 

04  59.5  16  14  24  55  43.5  51  53  56 

05  54  13  19  37.5  76.5  27.5  10.5  76.5  55.5 

28  29  30  31  32  33  34  35  36 

03  56  31  41.5     8  80.5  "20  16  80.5  36 

04  54  47.5  63      6  65  12  26  72  42 

05  42  55.5  44.5     9  59  23  14  48  76.5 


37 

38 

39 

40 

41 

42 

43 

44 

45 

80.5 

27 

64 

59 

69 

48 

80.5 

80.5 

80.5 

85 

20 

80 

85 

73 

31 

70 

85 

79 

76.5 

30.5 

50 

76.5 

40.5 

44.5 

76.5 

76.5 

76.5 

46 

47 

48 

49 

50 

51 

52 

53 

54 

03 
04 
05 


03  33.5  80.5  21  57  22  35  53  80.5  60 

04  13  85  7  23  18  75  67.5  85  64 

05  8  76.5  20  26  10.5  76.5  34.5  76.5  76.5 

55  56  57  58  59  60  61  62  63 

03  58  65  67  62  47  30  68  80.5  24 

04  78  57  71  35  29  49  43.5  62  39 

05  57  76.5  61  76.5  50  29  76.5  76.5  18 

64  65  66  67  68  69  70  71  72 

03  66  80.5  1  41.5  4  80.5  80.5  23  44 

04  67.5  66  1  37       3  50  85  34  46 

05  76.5  34.5  34.5  76.5     3  27.5  76.5  44.5  76.5 

73  74  75  76    -  77  78  79  80  81 

03  2  80.5  80.5  63       5       6  49.5  25  18 

04  4  30  85  76       5  25  52  22  11 

05  15.5  21  76.5  44.5     5  24.5  76.5  22  5 


79 


82 

83 

84 

85 

86 

87 

88 

89 

90 

03 

80.5 

17 

49.5 

28.5 

32 

28.5 

61 

38 

39 

04 

77 

8 

45 

38 

28 

41  . 

69 

21 

58 

05 

76.5 

15.5 

76.5 

58 

40.5 

32 

76.5 

7 

50 

03 

33.5 

04 

33 

05 

76.5 

80 


APPENDIX  D 
COEFFICIENT  OF  CONCORDANCE  DATA  FOR  FACULTY  AND  STUDENTS 


1 

2 

3 

4 

5 

6 

7 

8 

9 

Faculty 
Students 

18.5 
28 

136 
56 

136 
176.5 

136 
106.5 

136 
109 

136 
25 

36.5 
143 

33.5 
40 

33.5 
103.5 

10 

11 

12 

13 

14 

15 

16 

17 

18 

Faculty 
Students 

64 
79 

136 
176. 

5 

45.5 
6 

67 

99 

64 
46 

1 
4 

136 
53 

54 
50 

136 
135 

19 

20 

21 

22 

23 

24 

25 

26 

27 

Faculty 
Students 

136 
108 

2. 
33 

5 

59 
61.5 

67 
23.5 

136 
176.5 

136 
176. 

5 

136 
73 

59 
66 

64 
147 

28 

29 

30 

31 

32 

33 

34 

35 

36 

Faculty 
Students 

136 
27 

29. 
141 

5 

59 
150 

136 
139 

136 
20 

136 
176. 

5 

136 
87 

136 
130 

70 
83 

37 

38 

39 

40 

41 

-  -42 

43 

44 

45 

Faculty 
Students 

136 
176.5 

54 
71 

136 
158 

136 
115 

56 

84 

50. 
117. 

5 
5 

136 
47 

17 

31 

76 
55 

46 

47 

48 

49 

50 

51 

52 

53 

54 

Faculty 
Students 

136 
34 

136 
176, 

5 

40 
8 

80 
68 

136 
138 

136 
176. 

5 

136 
57 

81 

88 

10 

48 

55 

56 

57 

58 

59 

60 

61 

62 

63 

Faculty 
Students 

136 
127 

136 
176. 

5 

136 
58 

136 
18 

136 
92 

136 
116 

31.5 
100 

136 
75 

136 
129 

64 

65 

66 

67 

68 

69 

70 

71 

72 

Faculty 
Students 


47.5  136 
19     21 


136 
39 


136 
152 


136 
77 


136 
91 


136 
26 


136    136 
176.5  136 


Faculty 
Students 


Faculty 
Students 


Faculty 
Stu-lents 


73 

74 

75 

76 

77 

78 

79 

80 

81 

11 
45 

136 
176.5 

136 
161 

136 
154.5 

14.5 
176.5 

136 
144 

136 
142 

136 
121 

136 
125 

82 

83 

84 

85 

86 

87 

88 

89 

90 

67 
159 

12 

29 

136 
162 

14.5 
37 

136 
176.5 

69 

50 

28 

59 

5 
12 

31.5 
42 

91 

92 

93 

94' 

95 

96 

i  97 

98 

99 

136 
41 


14.5  136 
102    114 


136 
140 


52     78 
117.5  134 


77 
30 


136 
131 


81 


100 

101 

102 

103 

104 

105 

106 

107 

108 

Faculty 
Students 

136 
153 

136 
60 

24.5 
52 

21 

76 

36.5 
90 

136 
82 

136 
176.5 

72.5 
15 

7 
16 

109 

110 

111 

112 

113 

114 

115 

116 

117 

Faculty 
Students 

136 
105 

24.5 
43 

136 
106.5 

36.5 
9 

136 
110.5 

136 
146 

36.5 

5 

2.5 
13 

136 
156 

118 

119 

120 

121 

122 

123 

124 

125 

126 

Faculty 
Students 

136 
176.5 

39 

22 

136 
154.5 

22 

44 

136 
81 

136 
157 

18.5 
23.5 

136 
61.5 

136 
113 

127 

128 

129 

130 

131 

132 

133 

134 

135 

Faculty 
Students 

136 
112 

136 
176.5 

136 
125 

9 

1 

136 
119 

136 
70 

41 
10 

136 
97 

136 
176.5 

136 

137 

138 

139 

140 

141 

142 

143 

144 

Faculty 
Students 

136 
93 

79 
120 

136 
50 

136 
176.5 

20 
86 

136 
176.5 

136 
176.5 

47.5 
133 

54 
176.5 

145 

146 

147 

148 

149 

150 

151 

152 

153 

Faculty 
Students 

136 
176.5 

136 
149 

136 
36 

136 
122 

136 
176.5 

45.5 
7 

24.5 
11 

29.5 
137 

136 
125 

154 

155 

156 

157 

158 

159 

1-60 

161 

162 

Faculty 
Students 

24.5 
103.5 

59 
32 

136 
14 

136 
160 

136 
89 

7 
64.5 

62 
67 

50.5 
110.5 

136 
54 

163 

164 

165 

166 

167 

168 

169 

170 

171 

Faculty 
Students 

136 
94 

43.5 
35 

49 
151 

43.5 
74 

136 
95 

4 
3 

136 
176.5 

136 
69 

82.5 
17 

172 

173 

174 

175 

176 

177 

178 

179 

180 

Faculty 
Students 

74 
128 

136 
101 

136 
98 

72.5 
145 

136 
72 

82.5 
78 

136 
132 

27 

38 

59 
64.5 

181 

182 

183 

184 

185 

186 

187 

188 

189 

Faculty 
Students 

14.5 
96 

136 
123 

136 
85 

75 
80 

136 
176.5 

71 
176.5 

42 
63 

136 
176.5 

136 
176.5 

190 

191 

192 

193 

Faculty    136    136    136    136 
Students   176.5   148    176.5   176.5 
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APPENDIX  E 
COEFFICIENT  OF  CONCORDANCE  DATA  FOR  FACULTY  AND  ALUMNI 


1 

2 

3 

4 

5 

6 

7 

8 

9 

Faculty 
Alumnus 

1 
10 

59 
83 

88.5 
21 

54 
18.5 

26 

18. 

5 

59 
41.5 

21.5 
83 

19. 
43. 

5 
5 

4 
41.5 

10 

11 

12 

13 

14 

15 

16 

17 

18 

Faculty 
Alumnus 

51 
83 

46 
83 

3 

1 

18 
43.5 

78. 
83 

5 

33 
39 

69 
83 

105 
83 

62 
83 

19 

20 

21 

22 

23 

24 

25 

26 

27 

Faculty 
Alumnus 

105 
83 

32 
83 

105 
83 

34.5 
35.5 

105 
83 

30 
83 

43 
37 

73 
32. 

5 

16.5 
83 

28 

29 

30 

31 

32 

33 

34 

35 

36 

Faculty   19.5   46     52    105   .  29     41.5   59     82    105 
Alumnus    9     49     83     83     23    "52     83     83     53 


37 

38 

39 

40 

41 

42 

43 

44 

45 

Faculty 
Alumnus 

7 
5 

93 
83 

31 
83 

90.5 
83 

105 
83 

40 
17 

53 
83 

49 
83 

11 
29.5 

46 

47 

48 

49 

50 

51 

52 

53 

54 

Faculty 
Alumnus 

46 
83 

105 
83 

59 
83 

59 
83 

105 
83 

39 
6 

6 
83 

25 
83 

27 
83 

55 

56 

57 

58 

59 

60 

61 

62 

63 

Faculty 
Alumnus 

41.5 
7.5 

105 
83 

105 
83 

85 
83 

12 

45 

38 
15 

76 

83 

75 

83 

90.5 
34 

64 

65 

66 

67 

68 

69 

70 

71 

72 

Faculty 
Alumnus 

105 
50 

80 
83 

85 
83 

46 
83 

10 
83 

105 
12.5 

23 
21 

46 
83 

82 
83 

73 

74 

75 

76 

77 

78 

79 

80 

81 

Faculty 
Alumnus 

14 
21 

56 
83 

78.5 
83 

5 
11 

34.5 
83 

77 
83 

74 
83 

8 
4 

50 
83 

82 

83 

84 

85 

86 

87 

88 

89 

90 

Faculty   13    105     87     28  „   105     92     15     82     36.5 
Alumnus   24     51  .   83     29.5   35.5   83   -  28     12.5   16 
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Faculty 
Alumnus 


Faculty 
Alumnus 


91 

92 

93 

94 

95 

96 

97 

98 

99 

66 
83 

36.5 
39 

16.5 
83 

9 
3 

64.5 
83 

105 
32.5 

105 

83 

105 
26.5 

85 
31 

100 

101 

102 

103 

104 

105 

106 

107 

108 

24 
26.5 

105 
83 

2 
2 

71.5 
54.5 

71.5 
48 

63 
83 

67 
47 

68 
54.5 

94 

83 

109 

110 

111 

112 

113 

114 

115 

Faculty    88.5   105     70     64.5   21.5  105     55 
Alumnus    14     39      7.5   83     83     46     25 
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